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As  an  outgrowth  of  earlier  research  in  Navy  flight  grading  (8,  12), 
this  study  evaluated  a basically  different  type  of  daily  flight  grading 
form  from  that  currently  in  use  in  the  Naval  Air  Basic  Training  Com- 
mando The  major  difference  inherent  in  the  experimental  grading  forms 
tried  out  in  this  study  ie  that  they  are  used  to  record  performance 
in  terms  of  exactly  what  a student  did  during  a flight.  In  the  cur- 
rently used  Navy  AT«F  grading  forms  performance  is  rated  in  terms  of 
judgments  of  quality  of  overall,  performance  made  in  terms  of  a hypo- 
thetical "average"  performance. 

Both  types  of  grading  forms  were  evaluated  utilizing  experienced  Naval 
aviators  undergoing  instructor  training  as  students,  and  highly  ex- 
perienced instructors  from  the  Instructor  Basic  Training  Unit  (Flight). 
Evaluation  in  a system  such  as  this  enables  the  investigators  to  make 
the  statement  that  unless  the  forma  prove  worthwhile  in  this  situation 
under  more  or  leas  ideal  conditions,  there  is  little  hope  for  their 
success  under  less  desirable,  common  operating  conditions  in  the  train- 
ing squadrons.  It  must  also  be  noted  that  the  success  of  grading  pro- 
cedures evaluated  in  'this  manner  does  not  necessarily  preclude  their 
u>  success  in  grading  Naval  Aviation  Cadets. 

The  major  conclusions  of  this  study  indicate  that  grading  of  the  ex- 
perimental type  is  equally  as  reliable  and  valid  as  the  Navy  ATJ  grading 
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forms,  in  terms  of  consistency  and  ability  to  predict  future  perform- 
ance, Further,  it  was  conclusively  shown  that,  for  the  group  under 
observation,  the  experimental  forms  offered  far  less  opportunities  for 
distortion  of  grades  through  !halo*  effects  based  on  unrelated  p ere  css- 
'll lty  characteristics  and  knowledge  of  past  performance.  The  diagnostic 
value  of  this  experimental  grading  is  also  noted, 

^or  certain  types  of  flight  performance,  it  was  concluded  that  the  ex- 
perimental typo  of  grading  was  superior  to  the  currently  used  Navy  ATJ 
methods  for  \ redictions  of  short-range  future  performance.  It  wan  fur- 
ther found  that  the  grades  on  flight  proficiencies  are  somewhat  improved 
by  the  addition  of  a subjective  judgment  of  such  attributes  as  "head work", 
"mentsl  attitude",  "reaction  toward  flight"  and  "air  discipline",  -These 
four  attributes  are  currently  a part  of  the  Navy  ATJ  grading  forms,  and 
it  is  recomaended  that  future  grading  methods  continue  to  include  in- 
stTUCtors  judgments  of  these  attributes. 

It  was  found  that  instructor  attitudes  toward  in-flight  grading  were 
improved  through  continued  use  resulting  in  better  familiarisation  with 
the  techniques  required.  It  was  further  found  that  predictiveness  of 
measurement  by  the  current  Navy  system  of  grading  improved  during 
the  study.  This  iaprovsaeat  is  felt  to  be  due  to  a.,  increased  aware- 
ness on  the  pari  of  the  instructors  of  the  more  critical  aspects  of 
differential  student  flight  performance. 


CHAPTER 


INTRODUCTION 


•nils  study  r»p;rsssnts  a farther  step  in  the  continuing  effort  e©  the  pert 
of  the  Wavy  to  develop  accurate  and  meaningful  flight  grading  procedures. 
Earlier  » todies  in  this  area  are  reviewed  in  Chapter  XI*  following. 

SjpeMal  prcbleas  have  been  encountered  in  these  stadias  which  wake  dif- 
ficult the  adequate  interpretation  of  results.  One  of  these  problems 

somerm  the  day-to-day  variability  in  performance  of  i5at=l  Aviation 
Cadets.  Another  problem  is  the  difficulty  of  properly  orienting  and  in- 
doctrinating flight  snstruoiavs  in  the  principles  and  evesy-day  use  of 
objective  grading  Icvfcsiques , Still  father  problems  result  reoors- 
Mendaiions  are  adds  regarding  the  iBftlenentation  of  new  grading  sotaexte 
which  are  based  on  the  results  of  experimental  evaluations. 

7L*  vsrisibilita  of  daily  perforannea  seriously  affects  the  statistical 
evaluation  of  grading  s&thods.  For  exuqple,  the  determination  of  relia- 
bility is  dependent  upon  the  aeasurenent  of  two  identical  pexxuzssasuej  o» 
the  ssaasca-ewast  of  one  performance  by  two  observers.  Since  flight  grading 
in  training  aircraft  as  necessarily  to  m#  6 ©server,  the  assess- 

sent  of  reliability  Bruit  be  based  on  ths  consistency  with  which  a grading 
nothod  assurors*  student  performance  on  two,  or  ifcre,  flights  * 

If  a student*  s performance  cm  two  consecutive  flights  is  souilbtcct;  his 
grades  c®  these  flights  should  be  highly  correlated.  Any  leek  of  re'La- 
tionehis  is  then  ecmtributs.ble  to  the  unreliability  of  either  the  grading 
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fora,  or  the  individual  rater.  However,  since  student  flight  performance 
is  not  consistent  from  day-to-day,  the  problem  is  encountered  of  attempt- 
ing to  reliably  measure  an  unreliable  performance. 

Criteria  for  the  validation  of  grading  procedures  oust  be  Meed  on  the 
prediction  of  success  froa  some  earlier  measure.  Again  the  day-to-day 
variability  of  student  performance  causes  eueh  predictions  to  make  it  ink- 
possible  to  select  the  particular  flight  which  ie  most  representative  of 
the  student's  overall  ability. 

Since  it  is  impossible  to  isolate  the  unreliabilities  of  the  student  and 
of  the  grading  method  without  first  developing  a highly  reliable  grading 
form,  it  was  felt  that  this  study  should  concentrate  on  the  development  of 
such  a form  under  conditions  where  a minimum  of  variability  in  performance 
existed,  lb  do  this,  a group  of  experienced  Naval  Aviators  in  training 
was  selected,  on  the  assumption  that  their  performance  on  simple  flight 
maneuvers  would  be  relatively  stable. 

The  difficulties  involved  in  the  orientation  and  indoctrination  of  flight 
instructors  was  also  felt  to  be  minindssd  in  the  Instructor  Basic  Training 
unit,  as  the  clef  f Instructors  l*Oix  «T»  a highly  select  group  of  instruc- 
tors experienced  in  the  training  of  Naval  Aviation  Cadets. 
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In  coed  acting  this  study  under  somewhat  ideal  conditions,  it,  must  be  rec~ 
ognisod  at  the  outset  that  the  interpretations  of  results  must  be  viewed  in 
light  of  several  limitations.  First,  there  is  a considerable  difference 
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in  using  a grading  method  in  a small  group,  where  Individual  attention  can 
W given  to  raters.  ss£  the  iiijil  Sawtstlcs  o£  a large  scale  grading  operatiffl 
is  a training  unite  Second,  the  differences  between  the  experienced  Naval 
Aviator  and  the  Cadet  may  be  so  great  as  to  make  impossible  similar  grading 
processes  for  the  two  groups*  Close  attention  was  paid  to  the  differences 
between  experimental  and  operating  conditions  in  this  study,  and  the  results 
are  interpreted  in  terras  of  these  differences. 

xhe  specific  areas  which  are  investigated  in  this  research  involve  the  prob- 
lems of  in-flight  vs.  post-flight  grading,  reports  of  actual  performance  vs. 
subjective  judgments  of  qualitative  proficiency,  and  instructor  acceptance 
of  newly-designed  grading  techniques.  -Specif lo  questions  to  which,  answers 
are  sought  include  the  following : 

1«  By  what  standards  are  students  currently  measured  and 

hov  reliable  is  this  measurement? 

2.  How  wall  can  check-flight  performance  be  predicted 
frees  daily  performance  within  a stage  of  training? 

3.  Can  a grading  aye  tea  feasibly  bs  developed  which  mini- 
Kises  the  influence  of  non-rel&teA  effects  of  student 
imcc  Instructor? 

k,  Gan  a gse-ling  system  be  devised  which  would  be  equally  as 
efficient  with  new  instructors  as  with  experienced  ones? 

5.  tauei  as  done  in  order  ♦*»  ir^loasat  a sow  sethed 

of  grading? 

the  answers  to  these,  and  other  questions,  are  male  at  the  basis  of  experi- 
mental conditions,  and  oust  bs  modified  in  teres  of  training  conditions. 
However,  since  the  conditions  under  which  this  study  is  conducted  are  con- 
siderably more  favorable,  it  can  be  stated  that,  unless  e grading  system  Is 
found  to  be  reliable,  valid  end  useable  here,  there  is  little  hope  for  its 
success  under  less  favorable  conditions  in  the  cadet  training  squadrons. 


* 


3 
1! 
£ 
2 

4 


i 

1 


! 


J 

I 

I 

i 


i 

f 


I 


i 


I i 

i 

i 

! 


HISTORICAL  EftCRQROUHE 


Usee  of  Flight  Grading  Techniques 

The  effectiveness  of  any  training  program  is  related  to  the  accuracy 
with  which  measures  of  proficiency  of  its  students  reflect  their  actual 
ability.  Measures  of  flight  performance,  during  both  training  and 
operational  tasks,  make  up  the  foundation  upon  which  administrative 
training  decisions  are  made.  Without  accurate  measures  of  proficiency, 
little  could  be  said  about  student5 s readiness  to  attempt  more  difficult 
phases  of  training,  or  about  the  feasibility  of  investing  extra  time, 
effort  and  money  in  borderline  cases.  If  such  measurement  is  accurate, 
a sound  basis  is  provided  for  making  such  decisions  c<.-mcerning  ad- 
vancement. 
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A further  need  for  ta^jroved  measures  of  proficiency,  particularly  in 
highly  eonplcx  tasks  such  as  flying  modern  aircraft  is  in  the  area  of 
diagnostic  evaluation.  Here,  reference  is  made  to  the  grading  of  de- 
tails of  performance  in  such  a manner  that  a student's  record  will  re- 
flect hla  specific  strengths  and  weaknesses.  Tf  these  measures  are 
diagnostic  in  nature,  their  results  can  be  used  to  gear  further  train- 
ing to  the  specific  needs  of  the  individual  student. 

Of  importance  also  is  the  use  of  proficiency  measures  taken  during 
training  and  in  ultimate  assignments.  These  aveasuree  are  necessarv  for 
determining  the  value  of  differing  vJ|/SS  of  training  procedures,  use  of 
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didaie  selection  methods. 

This  project  is  a part  of  the  continuing  effort  on  the  part  of  the  ?«a\ral 
Air  Training  CoQ°Knd  to  nr aviAes  usable  methods  of  afifefrorlng  flying  per- 
formance accurately . It  is  hoped  that  meosureasat  can  be  is^rcvrd  so 
that  it  Hey  serve  as  a sound  basis  both  for  administrative  decisions 
and  for  future  research  in  the  is^overaent  of  selection  and  training. 

The  Meed  ffflT  Imoroveaeait  gLfaflMt  Qradae 

For  naay  years  subjective  ratings  of  flying  Rbil  Jty  have  been  used  as 
the  basis  for  grades  in  Naval  Air  Training  on  all  instructional  flights. 
These  subjective  grades,  along  with  the  written  oora&enie  of  the  flight 
instructor,  mk&  up  the  largest  portion  of  available  information  on 
which  decision*  are  made  regarding  attrition  or  reWtioa  of  borderline 
students.  Research  in  development  of  new  selection  tests  and  e- 
valuation  of  training  programs  and  training  devices  sust  depend  for 
criteria  on  the  numerical  scores  derived  fros  those  subjective  grades 
and  on  the  fact  that  a student  completed  training  or  attrited  from  the 
program. 

In  connection  with  a large  scale  research  project  designed  to  provide 
improved  selection  tests  for  Naval  Ala?  Training,  The  Psychological  Corp- 
oration undertook,  at  the  request  of  the  Bureau  of  Medicine  and  Surgery, 
a projeot  to  determine  the  reliability  and  validity  cf  the  abovermenticn- 
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ed  subjective  grades,  ifcat  study  (1)  published  in  Nay  3949,,  Involved  a 
atatiatical  analysis  of  data  from  the  flight  training  Jackets  of  557 
Naval  Aviation  Cadets  ii>  Basis  Training,  In  the  course  of  this  analysis. 
It  becajra  clear  that  the  subjective  rating  scales  need  to  determine 
flight  grades  were  not  highly  reliable.  They  did  not,  furnish  satisfac- 
tory prediction:!  of  later  proficiency,  nooe  adequate  criteria  for  the 
evaluation  of  selection  tests  and  training  experiments. 


The*,*  conclusions  concerning  grades  in  Basic  Training  were  confirmed 
is  & similar  study  of  Kaval  Air  Advanced  Training  grades  (8)  published 
ir  1950.  Additional  evidence  frexa  many  sources  airports  the  general 
conclusion  that  flight  grades  based  exclusively  on  subjective  ratings 

are  inadequate  for  predicting  success  ir.  the  training  program. 


MUs&ktewa.  £&£  2$Bxsxsm&L  sss.  SacfiJ&Le 

In  addition  to  pointing  out  deficiencies,  research  on  the  problems*  of 
flight  grading  has  suggested  assy  methods  of  isproveaent.  One  of  the 
most  promising  techniques  is  the  standardised  flight  end  objective 
reec^e  ThJ«  wthod  was  developed  early  in  Vfcrld  ttvr  II  by  the  see- 
ni  l tee  of  Aviation  Psychology,  national  Research  Council  (11),  and  has 
received  « large  share  of  the  attention  of  aviation  research  personnel 
during  the  past-  few  ysars. 

The  ®r»t-  successful  sj^jlicstion  of  this  method  was  Gordon* a (3)  devel- 
opment of  a standard  flight  check  for  rating  the  airline  transport  pilot. 
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The  reliability  of  this  abaci:  flight,  as  determined  in  a tryout  with 
escwlwKiad  pilots,  is  tb«  highest  ever  reported  for  v*o  euoeeeeive  ehecji 
rides  graded  by  two  different  check  pilots,  being  .58  In  one  stud/ 
and  .76  in  a later  one  (3).  In  a further  revision  of  this  abaci:  flight, 
a ride-ride  reliability  of  *75-  obtained  for  two  successive  check  rides 
graded  by  two  different  raters  using  airline  pilots  as  subjects  (10)* 

Bflgfljjgto  SL  *2253&  S&Bs. 

Tho  U.  S.  Naval  School  of  Aviation  Medicine  and  The  Payohologlonl  Corp- 
oration conducted  a Joint  project  in  1951  to  develop  and  evaluate  ob- 
jective, in-flight  grading  )uathOu»  for  two  stages  of  Naval  Air  Training1 
(12).  The  plan  of  that  study  followed  the  plan  utilised  by  Gordon  (3), 
with  certain  nodif icaticna  necessitated  by  the  differences  in  the  task 
performed.  Modifications  were  cade  also  in  light  of  the  findings  of 
previous  Navy  flight  grading  research.  The  general  approach  involved; 

1.  Concentration  on  standardised  check  flights  as 
the  primary  measure  of  proficiency. 

2.  Obtaining  an  itesiaed,  objective  record  based  on 
what  the  student  actually  did  during  the  flight. 

3.  Ca-flight  marking  of  the  performance  as  it  occur- 
red or  as  scoci  thereafter  as  possible. 

Insuring  c clear  definition  of  tbs  maneuvers  to  be 
performed  and  the  Dinner  in  which  they  ware  to  be 
graded. 

The  major  eaaph&sia  in  this  study  was  placed  on  determining  the  reliability 


1 

She  two  stages  selected  were  pre-solo  primary  and  basic  instrument.  Fre- 
eclo  primary  was  chosen  because  most  flight  failures  occur  there,  making 
any  ispf*wenent  in  accuracy  of  grading  highly  desirable.  The  basic  in- 
strument stage  wee  selected  since  instrument  flying  appeared  to  lend 
itself  easily  to  objective  grading. 
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of  the  check  flight  grade  on  two  successive,  identical  flights  adminis- 
tered by  two  different  flight  instructors.  In  addition  to  this,  internal 
reliabilities  of  the  foras  wars  deieraiEed,  and  instructor  coosnenta  were 
collected  regarding  the  utility  of  such  a grading  system  for  routine  use. 

The  results  of  this  study  revealed  that  the  grading  measures  developed, 
and  tried  out  did  not  prove  superior  to  -fee  currently  used  subjective 
measures.  T he  forms  did,  however,  possess  fairly  high  internal  re- 
liabilities. Even  if  the  form?  had  been  revealed  to  have  high  ride-ride 
reliability,  mo  recommendation  would  have  been  nsdc  for  their  routine 
use  in  training  situation  without  considerable  simplification.  The 
reason  for  tM?  was  that  the  majority  of  instructors  reported  teat 
they  believed  the  coaplexity  of  the  forms  caused  the*  to  be  dangerous 
for  daily  in-flight  grading. 

Pienntttg  the  Present  Study 

World  Vfer  II  studies  in  the  Amy  Air  Forces  revealed  that  attempts  to 
iiqvmve  ride-ride  reliability  often  failed  because  of  erratic  day-to-day 
fluctuations  is  performance,  rather  tom  because  oi  BHeasuxeuieut  errors 
(9,  p-jfil).  The  Ax^y  Air  Force  tha  Navy,  in  their  attempts  to  im- 
prove reliability  of  flight  grades  utilised  trainees  in  their  respective 
programs  as  subjects  for  their  studies.  Gordon  (5)  and  Nagay  (10)  in 
the  Airline  Transport  Rating  studies,  where  high  ride-ride  reliabilities 
were  reported,  measured  tbs  performance  of  s^erieaced  pilots.  VUcoson 
and  Johnson  (12)  state,  concerning  the  possible  reasons  for  unreliability 
of  their  grading  form: 
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"If  we  may  suppose  that  the  grading  forma  used  in  this 
investigation  are  representative  cf  those  used  elsewhere* 
it  appears  that  the  most  likely  reason  for  low  ride-ride 
reliability  lies  in  the  variability  of  student  performance 
from  one  ride  to  the  next." 

On  the  basis  of  these  results,  the  present  project  vas  designed  to  utilise 
Instructors  Ufruer  Training  from  the  lostniaior  Basic  Training  unit  (Flight) 
as  subjects.  These  pilots  are  experienced  Havel  aviators,  and  therefore, 
were  assumed  to  be  more  stable  in  their  day-to-day  flying  performance 
than  cadets . It  was  also  designed  to  collect  measures  of  flying  ability 
on  each  of  the  instructional  flights  in  a particular  stage  of  training, 
sad  to  simplify  these  measures  in  order  to  increase  their  useability.  It 
is  fortunate,  also,  that  the  training  syllabus  of  this  unit  allova  for 
sequential  measures  of  proficiency  during  Instructional  flights. 
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CHAPTER  IK 

DSSCBXPHG&  OF  THE  STUDY 


JtA  Jag&asdte  Be ate  InisiuL  Ml 

This  unit  serves  two  mjo v functions  la  the  Haval  Air  Basic  Training  Coa- 
Hnd,  First,  the  emit  serves  to  train  Neva!  aviators  in  the  Methods  of 
instructing  cadets  in  tbs  various  maneuvers  taught  in  the  different  stages 
of  basic  training,  Second,  the  tmit  serves  as  a standardisation  control 

of  the  content  of  the  stages  and  sathods  of  irctrastisis  of  these  ssa- 
euvern,  Tbs  tmit  is  divided  into  a ground  division  and  a flight  diviol on* 
The  ground  division  conducts  lectures  on  tho  principles  of  instruction, 
practice  la  the  iu«w>iits  of  speech  and  ia&rotrinaiion  em  orientation  to 
tbs  policies  of  the  J&vul  Air  Basic  Training  Cosnead.  Its  program  is 
apprcodmtely  two  weeks  in  length.  The  flight  division  conducts  training 
and  practice  in  the  maneuvers  Which  saist  he  taught  is  the  air,  end  re- 
quires approximately  six  weeks. 


Instructors  TIao.er  Training  in  tbs  Primary  Stage  of  the  Instructor  Basic 
Training  l&lfc  (Flight)  perform  the  identical  maneuvers  that  Naval  Aviation 
Cadets  will  he  required  to  perform  in  the  Primary  syllabus  at  Waiting 
and  Coney  Fields,  After  successfully  ooepleticg  this  Primary  syllabus, 
including  two  check  flights,  one  on  high  work  end  one  on  low  work,  the 
Instructors  Sfcder  Training  advance  to  a second  stage  which  involves  the 
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l«a!ag  sad  practice  of  techniques  of  thsao  maneuvers. 

•Hsia  alternating  plan  of  perfersdng,  «sso  teaching,  continues  throughout 
the  several  stages  of  work. 

The  Primary  stage  wo  selected  for  evaluation  far  two  reasons,  First, 
it  is  closely  related  in  content  tc  the  Pre-solo  Primary  Stage  of  cadet 
training,  Second,  it  offers  so  opportunity  to  observe  true  tors 

Ubder  Training  in  the  early  stages  of  leexnlsg  and  daralcpeeanto  The 
learning  situation  here  is  actually  one  of  1 e-lcarning  the  tonics  in  which 
these  Naval  Aviators  were  trained  earlier  la  their  careers.  In  these 
stages,  concentration  is  an  flying  malls,  rather  than  on  the  learning  of 
instrootion&l  techniques.  The  latter  process  is  inherent  in  nest  other 
stages  of  the  Instructor  Basic  Training  Obit,  and  its  reoaouraaect  is  not 
evaluated  herein. 

The  relationship  of  instructor  to  student  offers  an  lapartent  contrast 
in  this  research.  The  instructors  attached  to  the  Instructor  Basic 
Training  tbit  have  been  selected  from  the  various  outlying  units  on  the 
basis  of  experience  and  proficiency.  The  Instructors  Under  Training, 
which  we  shall  subsequently  refer  to  as  "students'  throughout  this  report, 
are  experienced  Naval  aviators  reporting  to  the  Training  Coasiand  end 
thn»,  arc  different  in  many  respects  fro®  the  typical  Naval  Aristics  Cadet 
learning  to  fly  for  the  first  tine. 
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In  thi»?  exneriinentaX  tryout  of  a aev  grading  system,  therefore,  sore  or 
lees  ideal  conditions  of  ins  true  tors  and  students  esir/te.  Ths  observations 
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and  recordings  of  grades  are  Bade  "by  & select  group  of  experienced  flight 
instructors,  and  the  students  vim  are  being  observed  are  designated  pilots 
i*©  should  be  lees  variable  in  their  day-to-day  performance  than  cftfletc. 
The  limitations  due  to  these  differences  between  the  experimental  and  the 
real  training  situation  are  considered  below  in  the  conclusions  draws 
froei  the  results  of  this  study. 

3&  £rt&GS2  SxMaK 

The  j^euvers  perforsaed  is  the  priaary  stsge  are  divided  into  two  eooe- 
vbat  contrasting  types  of  work.  The  first  two  flights,  AX  end  Aj,  are 
p*8rl‘oxned  at  low  altitude  and  consist  of  practice  in  landisge,  takeoffs 
and  field  procedures  required  in  order  that  the  student  nay  be  csonsidered 
•safe  for  sdo1.  The  nart  wee  flights,  Ak,  A5  and  46,  are  perfcrasd 
at  a high  altitude  and  include  instruction  and  practice  in  Maneuver*  such 
as  spins,  stalls,  spirals,  etc.,  in  preparation  for  the  AJ  high  work  check 
flight.  The  next  three  syllabus  flights,  AS,  ky  and  AI2,  deal  vita  the 
low  work  contained  in  the  A13  check  flight.  This  include*  such  Maneuvers 
as  itiuch-agd-gG  landings,  snail  field  procedures,  standard  field  entries 
and  xot*  altltuae  energenoies,  tuaoug  others. 

In  correlating  the  grades  nade  on  the  low  16  rk  and  high  work  sections  of 
tho  Primary  syllabus,  fairly  low  relationships  were  found,  indicating 
that  the  material  covered  on  these  two  parts  is  soraevhai  independent. 
Statistical  analyses  in  this  study  are  therefore  made  separately  on  the 
two  parts  of  the  syllabus. 
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Tha  Jfffl  Flight  Forma 

The  standard  method  of  flight  grading  in  the  'wavy  is  a system  base d csa 
Instructor  judgment  of  student  performance  in  terns  of  individual  concepts 
of  a hypothetical  average  student.  The  ATJ  grading  fern  appearing  in 
Appendix  A is  representative  of  asiit  currently  used  Navy  grading  fons« 

It  contains  a listing  cf  the  aanewrers  performed  in  tbs  Primary  stage,  as 
veil  as  & listing  of  four  general  attributes.  These  attributes  are 
"headwrir' , "denial  attitude",  ''reaotioa  toward  flight"  and  "air  dis- 
oir>1  *1*6" , 


On  each  of  the  indices  of  flying  skill  and  attributes  Included  in  the  ATI 
fora,  the  instruot'v  may  rate  his  student  in  terms  of  deviations  fror. 
•'average"  in  four  possible  categories.  These  categories  are  "unsatisfac- 
tory", "below  average",  ''average"  or  “above  average".  The  large  majority 
of  all  marks  assigned  are  in  the  "average"  category,  with  deviations  up- 
ward or  downward  checked  when  appropriate.  No  set  number  of  Itesne  to  be 
graded  is  prescribed  for  a particular  flight,  rather,  the  instructor 
checks  only  those  iteas  which  pertain  to  the  flight.  The  ATJ  grading 
fora  is  filled  out  on  the  ground  at  stoat)  time  after  the  flight,  hud  be*** 

G onroad,  it  has  been  observed 
on  the  some  day  as  the  flight, 
flight. 


completed.  In  most  units  of  the  Training 
that  these  forms  are  generally  filled  out 
or  within  two  to  three  days  following  the 


These  forms  are  scored  by  totaling  the  number  of  marks  assigned  in  each 
of  the  four  categories.  No  other  numerical  assessment  of  flight  per- 
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fonmnee  is  sade  for  an  Individual  flight.  A cuaulative  total  is  kept 
oi  these  gurlg  sad  a slasdaat's  grade  for  a (specific  stags  wail  as 
his  final  grade  in  the  Basie  Training  Cosmnd  is  based  cc  the  era  total 
of  the  nuuber  of  narks  In  each  of  these  four  categories. 

In  this  study,  the  ATJ  grades  which  are  used  for  cooperative  purposes 
have  been  broken  down  into  two  separate  grades.  The  first  is  based  cn 
the  ratings  of  flight  perfomanoe  contained  in  the  first  part  of  the 
foxn  and  the  second  is  baaed  on  the  attributes  assessed  by  the  last  four 
itec£  of  the  fora.  It  is  felt  that  certain  differences  are  inherent  in 
these  two  factors  and,  therefore,  grades  should  be  computed  separately . 

The  Egaerimaatal  Design 

In  this  study,  experimental  grading  forms  were  developed  covering  s»ny 
aspeote  of  the  maneuvers  of  the  Primary  syllabus.  These  forms  were  de- 
veloped through  cooperation  with  a Pilot  Adviscvy  Boa-fd.  This  board 
consisted  of  three  staff  instructors  selected  from  the  Instructor  Basic 
Training  Tfcdt  (Plight).  These  grading  forms  included  those  aspects  of 
performance  'jflsich  v«rre  felt  ’ey  the  board  *nd  the  investigators  to  be  Meas- 
urable and  pertiaeut  to  flight  proficiency  measurement.  The  esperiianxtal 
grading  farm  were  filled  out  in  the  air,  followed  by  routine  grading 
with  the  Navy  ATJ  forms  at  eoae  tisae  following  the  flight. 

For  purposes  of  caparison,  two  groups  were  selected  for  study,  The  first 
was  a control  group,  consisting  of  one  hundred  end  sixty  students  in  the 
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Instructor  Basic  Training  Unit  (Flight)  from  April  12,  1955  through 
August  10,  1955»  Records  were  examined  and  analyses  made  of  the  grades 
of  these  students  on  the  standard  Navy  ATJ  grading  form*  The  second,  or 
e^erimsatsl  group,  consisted  of  the  population  of  sixty-seven  students 
xiuiutsu  during  the  period  from  r-eeeaber  1,  1955  tferough  February  19#  195^* 
The  eaperis^sitel  group  was  graded  by  both  the  Navy  AT.T  form  and  by  tbs 
newly  developed  experimental  grading  forms* 

The  staff  instructors  participating  in  this  study  wore  selected  on  a 
volunteer  basis  end  were  thoroughly  indoctrinated  in  the  use  of  the  ex- 
perimental grading  forms  prior  to  the  flights*  Analyses  wore  made  of 
these  grading  data  and  ocs^srisons  were  made  which  are  reported  in 
Chapter  V,  following*  At  the  dose  of  the  study,  questionnaires  were 
administered  to  part?  sips  ting  instructors  in  order  to  ebtel?  i”fr*irv«+5o” 
pertinent  to  the  evaluation. 


CHAPTER  17 


FR0C5DUEES  IH70L7® 

Develonasnt  of  the  Ssperiingnial  Grading  Eons 

To  assist  in  determining  the  maneuvers  to  be  graded  in  this  study,  a 
three-man  pane'*,  was  selected.  The  members  of  this  board  were  chosen  from 
volunteers  on  the  basis  of  being  ’typical*  of  the  majority  of  the  Staff 
Instructors  in  the  unit.  The  investigators  hold  numerous  meetings  with 
this  boat’d  and  examined  every  flight  contained  is  the  Primary  syllabus* 
Determinations  were  made  of  those  aspects  of  student  performance  Which 
vers  both  m*«umrfthle  and  pertinent  from  the  standpoint  of  flight  pro- 
ficiency evaluation. 

It  was  found  tret  m ay  critical  aspects  of  flight  do  not  lend  themselves 
to  purely  objective  grading;  that  is,  grading  based  on  actual  measure- 
meat  rather  than  on  obaarv*^  ipagMert.  For  these  aspects,  an  attenpt 
was  made  to  construct  the  forms  in  such  a way  that  instructors  reported 
what  a student  did,  rather  than  a judgment  of  the  quality  of  such  per- 
formance, This  often  required  a response  such  as  ‘’proper"  or  "incroper-" 
regarding  the  performance  of  a specific  task.  Although  such  items  re- 
quire judgments  to  be  made  by  the  instructors,  these  judgments  differ 
from  the  purely  subjective  to  reportings  based  on  performance  with  respect 
to  a standard.  The  judgments  made  on  the  Navy  ATJ  forms  arc  mads  with 

iAn  exaaple  of  pure  objective  measurraaeat  is  the  recording  of  an  instru- 
ment or  dial  reading,  while  subjective  measurement  is  exemplified  by  an 
assessment  of  a performance  by  an  observer  in  terms  of  “good"  or  "poor". 
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respect  to  an  individual  instructor* 8 concept  of  the  " average"  performance. 

In  cases  where  vaore  objectivity  was  possible,  items  were  constructed  in 
the  font  of  recordings  of  dial  readings, 

! 

« 

The  original  experimental  grading  forms  drawn  up  as  a result  of  these 
conferences  were  filled  out  in  the  air  on  several  flights  during  initial 
tryouts  by  the  members  of  the  advisory  board,  After  these  trials  were 

i 

! 

completed,  further  conferences  were  held  in  which  items  were  revised  and 
necessary  additions  and  deletions  made,  A second  revision  vros  then  tried 
out  in  a similar  manner,  and  in  soeac  oases  several  more  trials  were  nec- 
essary in  order  to  refine  the  forma  for  each  nsneuver  so  that  they  could 
be  presented  to  the  unit  for  use.  The  final  revisions  of  each  of  the 
forms  appear  in  Appendix  B and  were  gathered  into  booklets  of  approrin- 
ately  four  or  five  pages,  each  booklet  representing  a flight. 


The  forms  were  designed  with  a cardboard  backing  which  slipped  into  a 

specially  designed  knee  pad.  This  arrangement  mode  it  possible  for  the  , 

flight  instructor  to  turn  the  pages  one  at  a time  and  securely  fasten 

* *| 

them  in  back  with  a relatively  single  motion,  Hie  krec  pads  constructed  "■ 

i 

t 

for  use  in  this  study  were  similar  to  those  developed  by  Wilooxoa  and 

I 

Johnson  (12),  and  are  fully  described  in  that  work, 
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A grow  of  ten  volunteer  staff  instructors  were  selected  to  perform  the 
grading  of  students  in  the  eaperiscntal  group.  These  instructors  ware 
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carefully  indoctrinated  in  the  exact  procedures  required  for  filling  out 
the  experimental  grading  forms.  Care  was  taken  in  cases  where  Judgments 
of  proper  or  Improper  performances  ware  to  "be  mde  to  see  that  the  group 
as  a whole  was  standardised  with  respect  to  what  should  constitute  a 
correct,  or  an  incorrect,  procedure. 

As  the  auraber  of  students  in  the  experimental  group  increased  it  bee  ass 
necessary  to  add  to  this  nucleus  of  ten  original  instructors  until  a total 
of  twonty^eight  instructors  were  regularly  being  used  toward  the  latter 
part  of  the  study.  As  each  instructor  was  added  to  the  group,  he  was  in- 
dividually indoctrinated  in  the  use  of  each  of  the  grading  forms,  The 
esperiBHastel  grading  ferae  ware  distributed  as  a part  of  the  checking  out 
routine  before  each  flight  and  ware  returned  imnediately  following  the 

! ; flight. 

! 

) 
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The  number  of  items  graded  on  each  flight  cf  the  Primary  syllabus  by  the 
experimental  grading  forms  is  presented  is  Table  I and  is  therein  contras- 
ted with  the  number  of  items  graded  cm  the  ATJ  form, 

i 

I 

! 

I As  no  specific  number  of  iteme  is  required  in  completing  the  navy  ATJ 

! forms,  the  number  of  items  indicated  in  Table  I represents  the  nodal 

I 

| »tffl*er  filled  out  for  each  of  the  flights,  While  there  was  consideorable 

I variance  with  respect  to  the  individual  number  cf  iteme  checked  by  dif- 

ferent instructors,  all  flights  required  that  the  four  attribute  items  at 
. the  end  of  the  form  he  filled  out. 
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It  is  noted  that  the  experimental  grading  forms  contain  a considerably 
larger  number  of  items  on  which,  the  student  is  rated.  An  example  of  the 


TABLE  I 

M*©ER  OF  ITEMS  GRADED  ON  EACH  SXLLABUS  FLIGHT 
BI  ATJ  AMD  EXPERIMENTAL  FORMS 


FLIGHT 

DESCRIPTION 

NUMB  ER  OF  ITU© 

m 

A1 

Safe  for  solo  Chech 

9 

39 

A3 

Ictodttotory  lew  work  in 
precision  approaches  and 

jcKH-flap  landings 

10 

95 

Ah 

High  work  - stalls,  steep 
turns  and  precision  spins 

r\ 

7 

58 

A5 

Stalls,  slow  ii.l&nt,  spirals 
and  high  altitude  emergencies 

7 

32 

AS 

Review  of  high  work 

9 

96 

ATX 

High  work  check  flight 

14 

96 

AS 

T-r**  vsrvwlr  _ OtflAll  fSftlrt  Tirvu. 

cedure?  ana  low  altitude 
emergencies 

6 

57 

A9 

Touch  and  go  landings,  precision 
approaches  and  cross-wind  landings 

9 

35 

A12 

Review  of  l ow  work 

12 

116 

A1JX 

Low  work  check  flight 

Ik 

116 

grading  of  stalls  should  suffice  for  explanation  of  this  difference.  On 
the  Navy  ATJ  form,  or.o  item  is  provided  for  the  overall  assessment  of 
performance  on  all  stall  maneuvers.  On  the  experimental  formas,  each  stall 
performed  is  graded  separately  in  terms  of  performance  on  sis  different 
aspects.  Thus,  on  the  A6  flight,  containing  nine  different  types  of 
stalls,  one  item  is  graded  on  the  Navy  ATJ  form,  and  fifty-four  on  the 
experimental  form. 


! I 


Soor.l— £ wggriwij 
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The  Items  in  the  experimental  grading  forms  differed  among  themselves  with 
respect  to  possihilities  of  scoring.  Some  of  the  items  lent  themselves 
to  A dichotomy  of  ‘‘yea"  and  "no",  "proper"  and  "improper",  etc.  Others 
contained  three  ox*  four  choices  of  varying  degrees  of  correctness  of  per- 
formance. Still  others  included  dial  readings  in  the  form  of  marks  on  a 
scale  with  the  center  pc-irt  as  the  most  desirable  reading  for  a particular 

c£ii*eet  of  a •Smu.utw  q 


Danneskiold  (2),  In  an  earlier  flight  grading  study,  found  that  items  of 
this  type  could  graded  either  ac«ordiog  to  a multi-point  scale  o£  qual- 
ity of  performance  or  they  could  be  dichotomized  into  a correct  or  an  in- 
correot  response  based  on  group  performance.  In  that  study,  resultant 


bCO?«S  Cm  wvwSl  fOllUC  'JTCr’C  aS  v 


fora a watro  intcrcorrelated  by  coefficients  ranging  from 


.57  to  .99.  In  view  of  this  high  degree  of  similarity,  each  of  the  items 


of  the  experimental  grading  for*  as  broken  into  its  various  possible 
answers  and  **uoh  answers  were  tallied  for  the  group  under  study. 
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An  cxaflri  nation  of  these  group  responses  was  then  made  to  determine  a cut- 
off point  which  would  separate  correct  from  iaocrrect  responses.  Dichotomies 
were  assigned  to  every  item  so  that,  as  nearly  as  possible,  a grade  of 
* correct'  was  attained  by  approximately  fifty  per  cent  of  the  group.  In 
this  way,  the  iteu  difficulty  for  each  item  and  for  the  entire  fora  was 
adjusted  to  be  approximately  .50. 

The  initial  score  obtained  for  each  student  on  each  flight  was  a simple 
percentage  score  representing  the  total  number  of  items  scored  correctly 
divided  by  the  total  number  of  items  graded.  This  percentage  figure  was 
necessary  due  to  the  fact  that  in  some  cases  certain  parts  of  z nm^niver 
ware  omitted.  An  example  of  these  omissions  occurred  when  a touch-and-go 
landing  van  graded  up  to  the  point  of  touchdown  and  at  that  point  the 
student  would  be  given  a wave-off,  either  due  to  his  oun  exrur  or  due  io 
existing  conditions  in  the  traffic  pattern.  In  such  cases,  approximately 
60  per  cent  of  the  items  for  that  particular  landing  were  graded  with  the 
remainder  being  left  blank.  Another  eauqple  appears  on  the  high  work  check 
flight  where  nire  stalls  are  normally  performed.  In  a few  cases,  an  in- 
structor any  require  only  seven  or  eight  of  these  nine  stalls  to  be  per- 
formed, thus  causing  a alight  difference  in  the  total  number  of  items 
answered  for  the  flight  as  a whole.  In  no  case,  hows was  a flight 
considered  graded  for  purposes  of  this  study  if'  more  than  25  per  cent  of 
the  total  possible  items  were  omitted  for  any  reason. 
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Alternate  Scoriae  of  Bperlmental  Grading  Foraa 

Many  oonmenta  were  made  by  instructors  during  the  study  that  certain  as- 
pects of  a Eaneuver  were  distinctly  more  irocrtsnt  than  others  in  determin- 
ing student  ability.  Comments  were  also  heard  that  certain  maneuvers 
within  a flight  were  more  critical  then  others.  For  this  reason  it  was 
decided  to  atteapt  to  develop  a meaningful  method  of  weighting  various 
items  and  maneuvers  to  obtain  the  score  which  would  best  represent  the 
quality  of  student  performance. 

To  accomplish  this,  questionnaires  were  distributed  near  the  close  of  the 
study  which  contained  a listing  of  every  item  of  every  maneuver,  every 
maneuver  of  every  flight  and  every  flight  of  the  syllabus.  For  these 
listings,  the  Instructors  wore  asked  to  select  the  moat  important  and  the 
least  Important  of  these  items  and  maneuvers.  Instructions  were  given 
that  such  Judgments  of  importance  were  to  be  based  upon  factors  which  can 
be  used  to  differentiate  between  good  ana  poor  students.  The  question- 
naires were  administered  under  group  conditions  in  a classroom  of  the 
training  unit,  end  names  were  not  required  on  the  sheets. 

Tallies  were  made  of  the  responses  and  corresponding  ’/eights  were  assigned 
to  the  items  end  maneuvers.  In  many  cases,  high  agreement  was  found  e- 
mong  the  twenty-eight  experimental  instructors  participating  in  the  survey. 
Instances  were  found  where  $0  per  cent  or  more  of  the  group  felt  that  a 
particular  item  was  most  important  and  another  item  of  the  same  maneuver 
was  considered  least  important  by  a similar  percentage.  In  some  eases. 
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Item  and  maneuvers  appeared  to  be  considered  equally  iaportant  by  the 
group. 

The  experimental  forms  were  then  scored  in  accordance  with  these  weights. 
These  weighted  scores  were  found  to  correlate  .94  with  the  simple  raw 
scores  previously  obtained.  This  correlation  was  confuted  by  the  Pearson 
product  moment  method  for  all  flights  for  the  entire  group.  This  high 
degree  of  similarity  between  the  two  scores  indicates  that  there  is  little 
advantage  in  weighting  scores  oa  perfonnaace  of  this  type,  However, 
since  it  is  reasonable  to  assume  that  any  differences  between  the  two 
scores  would  undoubtedly  favor  the  weighted  score  as  a more  representative 
indication  of  quality  of  student  performance,  it  was  used  throughout  the 
statistical  analyses  described  below. 

QuBfitiamwirga  for  Further  Annlvais  g£  Instructor  Opinion 
In  order  to  assess  the  reactions  of  flight  instructors  to  the  experimental 
grading  forme  uaed  in  thle  study,  the  above  questionnaires  also  included 
provisions  for  unstructured  comments,  as  well  as  for  answers  to  the  fol- 
lowing four  questions: 

X.  Do  you  feel  that  these  grading  forms  would  be  a 
detriment  to  safety  in  the  air 

JlLJEHE  at  Milting  Fleld?^ 

TesQ  UoR  NoQ 


1 Whiting  Field  is  the  location  of  Basic  Training  Units  1(N)  and  1(S),  in 
Which  the  mjority  of  sll  Naval  Aviation  Cadets  receive  their  Primary 
Pre-Solo  training. 
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2.  Do  you  that  these  grading  forms  aro  superior  to 
the  UBM  forms  for 


tat 

m 

de-briefing  the  student? 

□ 

□ 

board  reviews  of  jackets? 

□ 

□ 

permanent  proficiency  records? 

u 

□ 

3.  Do  you  feel  that  these  grading  forms  are  most  valuable 
for: 


dally  instructional  hops? 

□ 

check  flights? 

□ 

both? 

□ 

neither? 

□ 

Do  you  feel  the  grading  fwww  could  be  shortened 

and  still  give  an  accurate  account  of  what  the  student 
did? 

Heoponses  to  these  items  were  tallied  and  a &la«rifioaiiou  hub  made  ox  to© 
unstructured  comments,  all  of  which  appear  in  Chapter  V,  below. 

S££d££  SL  2M  ££  S&StSL 

Tine  Navy  ATJ  grading  forms  on  which  students  in  both  the  experimental  and 
control  groups  were  graded  were  earned  in  terms  of  two  part  scores  and  a 
total  score.  The  first  of  these  pert  scores  vac  an  index  of  flight  pro- 
ficiency indicated  by  a weighted  sum  of  the  responses  to  each  of  the  air- 
work  items  included  is  the  first  pert  of  the  ATJ  ferc.  This  score  was 
obtained  by  weighting  the  total  number  of  responses  in  each  of  the  four 
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categories , Response*  in  the  unsatisfactory  —•Ggc.-y  were  given  weights 
of  0,  those  in  the  below  average  category  weights  of  1*  those  in  the  av- 
erage category  weights  of  2 and  those  in  the  above  average  category 
weights  of  3. 

A grand  total  was  then  obtained  for  this  part  of  the  form,  which,  in  turn, 
was  divided  by  the  nuaber  of  itero,  giving  an  average  score  for  flight 
proficiency.  This  averaging  was  neoessary  again  on  this  grading  fora,  as 
In  the  case  of  the  experimental  form,  due  to  the  faot  that  different  nuut» 
bars  of  items  were  answered  for  the  same  flight  by  different  instructors. 

The  second  peri  score  of  the  AXJ  grading  form  consisted  of  a sisdl&r 
totaling  and  averaging  process  for  the  four  attributes.  The  relationships 
between  those  attribute  scores  and  the  flight  scores  for  the  control  and 
experimental  groups  are  indicated  in  Table  II.  The  correlations  presented 


TABLE  II 


CQHEELATICMS  BETWEEN  TART  SOCKET;  OK  TilE  ATJ  GRADING 

ESPEKIKENIAL  GROUPS 


EWDWt?  ons  r»ri»J>rorrT  *\rr> 

»»»»•#  • v«i  vvnaia/u  mu/ 


GROUP  HIGH  WORK  LOW  WOFK 


MUX 

CHECK 

DAILY 

CHECK 

.34 

.44 

.17 

.31 

PXPERIHB?TA7. 

.53 

.36 

.12 

.34 

(*»■•*****(£ 
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are  Pearson  product  moment  coefficients,  sad  were  conputed  for  dally 
flights  between  the  two  part  scores  on  • cospcsite  total  daily  score  for 
low  and  high  work  individually.  These  scores  were  obtained  aj  oosvsr ting 
each  of  the  flight  scores  to  a standard  score  for  that  particular  flight, 
and  adding  these  standard  scores, 

The  relationships  are  c m to  be  fairly  low  between  the  two  measures,  in- 
dicating that  they  are  «owewbat  independent.  It  the r-foyo  decided  to 
evaluate  the  ATI  gr«4e  by  seans  of  flight  and  attribute  grades  separately* 
A third  score  for  the  ATJ  grading  forms  was  obtained  by  averaging  ail 
retings  given  on  the  flight  for  so  average  total  grade.  This  total  score 
corresponds  with  current  scoring  practices  In  the  Training  Comraand. 


CHAPTER  V 


BetMBflP 


gad  AffJ  Grades 


In  a study  of  this  type  where  an  experimental  method  of  grading  is  being 
compared  with  an  existing  method,  it  is  important  to  note  at  the  outset 
the  relationships  existing  between  the  two  methods  of  grading.  If  an 
estresely  high  correlation  is  found  between  the  grades  assigned  by  the 
two  different  grading  forms  then  it  can  be  assumed  that  little  improve— 
meat  is  possible  since  the  two  forme  are  measuring  essentially  the  same 
thing.  Pearson  product  messsnt  coefficients  of  correlation  were  computed 
between  scores  obtained  on  life  ATI  forms  »«d  on  the  experimental  forma 


TABLE  III 

RELATIONSHIPS  BETWEEN  TOTAL  SCORES  ON  ATJ  Al©  EXPERIMENTAL 
GRADES  pnn  DAILY  AMD  CHEEK  FLIGHTS  fN*67^ 


DAILY  GRADES 


CHECK  FLIGHT  GRADES 


RESEARCH  FINDINGS 


! 


for  IIJL^UUO  '**ww  m ““** 

are  presented  in  Table  III. 


for  the  two  cheek  flights.  These  correlations 


High  Work 
Low  Work 


High  Work  Check  Flight  .62 

Low  Work  Check  Flight  .69 


These  relationships  between  the  two  methods  of  grading  appear  to  be  slightly 
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higher  for  a single  check  flight  then  for  a combination  of  daily  flights. 
This  is  explained  by  the  fact  that  student  fluctuations  in  perfonmoae 
from  one  flight  to  the  next  are  areraged  ont  whan  several  daily  scores  are 
combined.  The  resultant  correlations  between  two  methods  of  grading  are 
therefore  lowered,  The  correlations,  in  general,  indicate  some  differ- 

? 

ences  Ik  performance  msasurement  are  obtained  an  the  experimental  grading 
form.  These  differences  are  not  as  distinct  as  they  appear,  since  the 
individual  reliabilities  wore  found  to  be  .65  and  .71  for  the  ATJ  and  ex- 
perimental forms,  respectively. 

The  above  relationships,  haying  been  aouputed  for  total  scores,  include 
the  common  element  of  ilva  attribute  «*eore  iii  each,  and  are  representative 
of  the  grades  which  would  ultimately  be  used  in  the  dasio  i'vaining  Goo- 
mend  (see  p«g£55).  Considering  grades  made  on  flight  performance  only, 
aociewhp.t  lover  relationships  are  presented  in  Table  IV,  It  appears  that 
measurements  of  considerably  different  flight  performances  arc  obtained 
by  the  two  methods. 

TABLE  IV 


RELATIONSHIPS  BETWEEN  FLIGHT  SCORES  ON  ATJ  AND  EXPERIMENTAL 
GRADES  FOB  DAILY  AND  CHECK  FLIGHTS  (N=6?) 

» 

1 

( 

DAILY  GRADES 

CHECK  FLIGHT  GRADES 

1 

! 

T 

High  Vfork  ,32 

High  Work  Check  Flight 

LA 
• »» 

! 

1 

Low  Work  ,1*0 

Low  Work  Check  Flight 

.1*6 
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Differences  in  Scores  Between  "Up"  Flights  and  "Down11  Flights 
In  the  Ksval  Mr  Basle  Training  Command,  each  instiruetioriai  flight  and 
check  flight  is  assigned  one  overall  judgment  of  passing  or  failing.  This 
judguraat  ie  made  by  the  individual  flight  instructor,  end  is  based  on  his 
general  assessment  of  the  student's  performance*  This  judgment  may  be 
made  either  in  terms  of  performance  of  required  maneuvers,  or  in  terms  of 
attitudes  and  reactions  toward  instruction*  Shis  general  asfleHetn»nt  re- 
sults in  the  flight  being  labeled  either  "up"  or  "down". 

Tn  the  two  mnmn  strdieu.  only  5-7  F®2*  cent  of  the  flights  in  the  con- 
trol group  sad  ^.0  per  cent  of  the  flights  in  the  experimental  group  were 
judged  as  "downs"-  Means  and  standard  deviation*  were  calculated  for  all 
aoorafa  on  both  grading  methods  for  flight*?  judged  as  " up^  and  flights 
judged  as  "down",  in  order  to  determine  whether  or  not  the  grades  of  these 
flights  differed  significantly  by  each  of  the  methods  of  grading. 

Each  of  the  differences  between  sseas  scores  an  "up"  flights  and  on  "down" 
flights  is  Table  V are  statistically  significant  at  better  than  the  1 per 
cent  xevex  of  com. wa-oufchwut  sill  grades  of  both  sables*  The  per~ 
foruiance  grades  assigned  by  both  methods  of  grading,  therefore,  produce 
significantly  lower  scores  for  those  flights  judged  as  "down"  than  for 
those  flights  judged  as  "up" . It  is  interesting  to  notes  that  on  the  ATJ 
grades  the  difference  between  an  "up"  flight  and  & "down"  flight  is  con- 
siderably greater  on  flying  skills  than  on  attributes. 
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Of  primary  concern  In  the  evaluation  of  a grading  system  are  its  relia- 
bility and  its  ability  to  predict  future  performance*  Tha  concept  of 


KEANS  AND  STANDA 


TABLE  V 


kA’nrs  nwrriiaTnttc 
'iuu/  /vuvxnAiuiiM 


OF  SCORES  ON 


PASSING  AND  FAILING  FLIGHTS 


CONTROL  GROUP  (N  **  loO) 
AT*T  GRADES 


EXFFiuiliav.CflL  GwOur  (H  » S“5 

iwmmm  »€»  ■mw— tmmmmm — mmmmmmmm t— w — mmmm mm — — — ■ 

ATJ  GRADES  E^ERIKESTAL  GRADES 


j 

M 

SD 

M 

SD 

K 

SD 

FLIGHT  SCORE: 

"Up" 

196.01 

27.14 

197.72 

26.16 

70.56 

50.29 

I6.96 

"DOUE! 

157 -55 

27-20 

147.55 

28.44 

15.85 

ATTRIBUTE  SCORE 

• 

• 

KUp" 

218.70 

20.92 

221.59 

21.11 

“Down" 

195*42 

16.57 

192.5E. 

16.62 

TOTAL  SCORE: 

"Up" 

204.27 

20.56 

206.61 

20*16 

70.76 

lt-85 

“Down" 

157.68 

22.15 

160.46 

25.50 

51.55 

16.4^ 

reliability  embraces  the  idea  that  a grading  system,  in  order  to  be  worth* 
•while,  must  be  accurate  end  consistent. 


There  are  three  general  methods  by  which  the  reliability  of  a test  is  as- 
sessed. One  of  these  procedures  involves  the  administration  or  a test  to 


«»o*  * :S«KJUw;  **ta,  i , 


'-If*** 
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a group  followed  by  a later  administration  of  the  same  teat  to  the  seats 

grntm.  Tn  this  altnatlcB.  tfcjnro  ahould  H#»  a high  relationship 

botvem  scores  sad*  *r?  individuals  at  each  of  the  testing  periods.  Aa- 
other  index  of  reliability  can  be  obtained  by  administering  similar  forms 
of  the  sans  tear,  to  a group.  Here,  the  relationships  between  the  soorea 
on  the  two  similar  tests  should  be  high. 


h 


i 

: 

j. 


the  most  acecaottly  used  method  of  determining  reliability  involves  the 
split-half  principle.  Hrre,  a test  la  split  into  two  chance  halve*,  and 
the  relationship  of  these  parts  is  coeputed.  These  helves  are  often  odd 
items  and  even  items,  or  the  chance  halves  may  be  selected  by  other  rac- 
oon, or  stratified  runciofn  methods. 

In  determining  ths  reliability  of  flight  grading  wthcds  the  naaaure  of 
rlde-rlde  reliability  has  often  been  used.  As  discussed  above,  this  ride- 
ride  reliability  figure  may  often  be  low  due  to  the  actual  variability  of 
student  aviators  In  their  perfomance  from  one  flight  to  the  nevt.  if 
these  fluctwlicne  are  great,  the  ride-ride  reliability  of  a grading  form, 
no  miter  how  accurate  and  ooaeiwtc:!  it  i«;  win  necessarily  be  low. 

An  attest  was  made  in  this  study  to  overcome  aowh  n/uciuatioud  by  using 
experienced  itfavnl  aviators  as  students,  and  by  averaging  several  daily 
performances.  Sue  split-half  reliability  determined  here  was  one  of  a 
composite  of  all  grades  tu  the  Primary  syllabus. 


i 

t 


I 


l 


* 

1 


j 


i 

i 

i 


i 


\ 

i 

i 

i 

\ 

I 


In  correlating  the  odd-maSbered  flights  agolnst  the  evea-nuabered  flights. 


I 
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t 

t 

l 

1 


t 

I 

i 


the  theory  Is  considered  teat  if  the  grading  forme  were  entirely  unreliable, 
the  Berk  assigned  u&  these  ions  would  be  tnj  better  than  chance  fading, 
and  the  correlation  between  odd  flights  and  even  flights  in  the  syllabus 
would  be  aero. 


Each  of  the  scores  made  by  both  methods  of  grading  in  the  e3periffien«al 
group  and  by  the  ATJ  method  in  the  control  group  wan  converted  to  stan- 
dard scores  and  cochined  so  that  each  student  received  a total  grade  for 
the  odd-stacbered  flights  and  a total  grade  for  the  even-® umbered  flights. 

the  correlations  between  the  cud-and  even-numbered  flights,  since  they 
represent  relationships  between  one  half  of  the  syllabus  and  the  other 
half  are  boosted  fcy  Mans  of  the  Spearnon-Brown  Prophecy  ?or*uXa  (4:275), 
and  are  presented  is  Sable  VI* 


TABLE  VI 

SPLIT-HALF  RELIABILITIES  OF  ATJ  AND  DCPERlHEWXAL 
GRAPH®  FOBrS  FOR  TIES  PRIMAHT  SILLABUB 


CONTBOL  GROUP  JSXPERIMEl«TAL  GROUP 


ATJ  ORAjDsS 

*TJ  GRADES 

E^KPJMEHTAL 

c*m>w 

night 

•v>3 

.61 

.10 

Attribute 

.42 

.59 

Total 

.57 

.63 

.71 

S-Tpr'-fV.-y-**  ►' 
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I 


t 

t 

I 

i 
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Ar,  examination  of  the  gplit-hsilf  rcliabili-tie#  in  Table  71  mat!  tint  tin 
flight  grades  obtained  on  the  experimental  fores  are  slightly  higher  than 
those  obtained  on  the  ATJ  grading  forms.  This  difference,  .70  ore ar  .61, 
lc  not  a statistically  significant  one,  as  determined  by  a conservative 
test  (S:175ff)  • The  reliabilities  of  both  forms,  however,  are  consider^ 
ably  high**  than  those  previously  found  on  a ride-ride  basis. 

In  considering  the  grading  of  flight  attributes,  it  is  noted  that  the  at- 
tribute scores  on  the  ATJ  grading  forms  for  the  control  group  war©  signi- 
ficantly less  reliable  than  the  flight  grades  £$r  this  group,  m the 
experimental  group,  however,  this  was  not  the  ease.  Since  the  grading  of 
attributes  appeared  to  be  equally  aa  reliable  as  the  grading  of  flight 
performance  in  the  experimental  group,  and  since  so  provision  use  node  in 
the  erpsriraental  grading  forms  for  aossesm&at  of  these  attributes.  It  was 
decided  to  combine  the  experiments!  flight  scores  with  the  ATJ  attribute 
scores  is  ths  hopes  of  obtaining  a more  stable  index  of  student  perform- 
ance. This  ecEfcin&tioe  w&s  also  done  at  the  request  of  the  flight  in- 
structors participating  in  the  study.  Many  of  tbsae  instructors  expressed 
the  desire  to  pneovide  for  grading  of  these  attributes  on  the  experimental 
grading  fores.  The  reliability  of  the  eaq^eriaental  grading  fore  ssa  not 
appreciably  changed  by  the  addition  of  these  flight  attributes. 


Rrediotlvenesa  of  Measurement 

In  order  »o  be  useful,  a grading  form  must  be  able  to  predict  future  par- 
foxr&nce.  Ute  greatest  «osd  for  prcdistic*-  is  flight  treinis®  is  in  de- 
termining the  long  range  future  success  or  failure  of  a student  pilot. 
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Soso  indication  of  this  predictivarviEB  can  be  obtained  by  studying  the 

floors  range  vcuiiUiigr  w.  o grna*Mft  «,***»« 

One  of  the  primary  interests  cf  this  study  was  to  dKiortiin*  if  a grading 
system  could  be  developed  which  would  predict  student  performance  on  a 
check  flight  from  his  performance  on  proceeding  dally  flights.  In  order 
to  accosplish  this,  the  three  daily  flights  of  each  part  of  the  syllabus 
were  combined  by  adding  standard  scores  to  produce  a daily  score,  which  In 
turn  was  correlated  with  the  cheek  flight  score.  The  Ah,  A5  and  A 6 flights 
couponed  the  entire  high  work  syllabus  which  is  evaluated  in  the  A7  check 
flight.  Low  work  performance  is  taught  on  the  Afl,  A9  and  AD .2  flights 
which  prepare  the  student  far  his  a15  uueck.  The  correlations  thus  ob- 
tained between  daily  flights  am  check  flights  are  reported  in  Tables  YU 
and  VIII,  and  show*  that  the  experimental  grading  forms  do  not  predict  the 
A7  check  flight  to  aa  great  an  extent  as  does  the  ATJ  method  of  grading. 

The  differences  are  not  significant,  however.  For  the  prediction  of  the 
A13  check  flight,  which  is  coaposed  of  low  work  Including  landings  and 
takeoffs,  tne  experimental  grading  form  appears  to  be  Bomswhai  superior. 

It  is  especially  interesting  to  note  that  in  both  predictions  the  validity 
of  the  experimental  form  was  Increased  by  adding  the  attribute  score  to 
the  scores  obtained  on  actual  flight  performance.  'il»e  prediction  of  the 
A13  check  from  the  conposite  score  of  the  A8  through  A12  flights  cf  ,62 
is  a very  high  one,  considering  the  reliability  of  the  form,  and  is  signif- 
icantly higher  than  «ny  obtained  by  A2J  grades. 


The  predictions  of  ATJ  grades  on  both  check  flights  frees  their  respective 
daily  grades  appear  to  be  slightly  higher  in  the  experimental  group  than 
in  the  control  group. 
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TABLE  VII 


PREDICTION  0?  AT  HIGH  WORK  CHECK  FRGM 
TOTAL  DAILY  LOW  NOEK  SCORES 


CONTROL  GROUP 


EXPERIMENTAL  GROUP 


\ 

EXPERIMENTAL 

* 

ATJ  GRADES 

ATJ  GRADES 

upni/ro 

Flight 

,Js6 

.50 

.34 

f 

Attribute 

.22 

.2 p 

Total 

.41 

•43 

.39 

f 

TABLE  VIII 

PREDICTION  OF  A1J  LOW  H)PK  CKFGK  "ROM 

TOTAL  DAILY  HIGH  WORK  GRADES 

CONTROL  GROUP 

EXPERIMENTAL  GROUP 

EXPERIMENTAL 

ATJ  GRADES 

ATJ  GRADES 

GRADES 

i 

i; 

Flight 

.28 

*?4 

.45 

Attribute 

.00 

.15 

j 

f 

Total 

.19 

.28 

.62 

5fi 
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A Silo  Analysis 

The  effects  of  intangible  and  often  unrelated  characteristics  of  a student 
upon  an  ins tree tor  are  referred  to  as  halo  effects.  It  is  not  imonqnon 
for  a well-groomed  and  eager  appearing  student  with  & (,ood  personality  to 
create  such  a favorable  ispreasion  toon  his  instructor  that  his  actual  p esv 
iozssnce  is  rct^t  ♦iiighcr  than  is  msTSStod^  SiBilsyly , the 

student  who  makes  an  unfavorable  impression  rasy  be  unjustly  rated  down  In 
his  actual  performance*  Also,  the  quality  of  a previous  performance  may 
often  influence  an  ±as  tractor'  c Judgasnt  of  a la-cr  performance. 

In  Navy  flight  grading  it  is  well  known  that  a student9  s past  performance 
plays  an  Important  part  in  Mazy  oases  in  the  grace  which  he  is  assigned 
on  a particular  flight.  Opportunities  for  this  type  of  distortion  of 
grades  are  greatest  there  evaluations  are  based  on  a subjective  judgment 
of  general  quality  of  performance. 

It  most  be  noted,  of  course,  that  student  performance  may,  in  fact,  be 
affected  by  the  presence  or  absence  of  a fondliar  instructor.  This  effect 
of  Instructor  on  student  is  independent  of  the  grading  matheda  enxloyed, 
end  such  methods  should  reflect  actual  performance,  rather  than  performance 
modified  by  the  effect  cf  student  upon  instructor. 
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In  order  to  evaluate  the  ooapemtiv©  halo  effect  of  the  ATJ  grading  forms 
and  of  the  experimental  forms  analyzed  in  this  study,  an  analysis  was 
undertake®  to  compare  the  grades  made  on  oemsemitive  flights  given  by  the 
?**s  instructor  and  to  compare  the  grades  made  on  consecutive  flights 


i 

I 

X-  . 


given  by  different  instructor*’. 


In  tbs  Instructor  Basie  Training  tvn<  ♦ 


the  students  are  usually  assigned  different  staff  instructors  for  each 


flight.  However,  instances  were  noted  where  two  consecutive  flights  were 
given  & student  by  the  same  instructor.  Sines  the  instructors  are  assigned 
more  or  less  by  chance  and  there  is  no  systematic  variable  operating,  it 
was  felt  that  ccupfirieoae  could  be  made  on  this  basis,  according  to  the 
following  plan: 

1.  Of  the  1648  flights  recorded  for  the  control  group,  53 
pairs  of  consecutive  flights  were  found  where  a student 
was  graded  by  the  same  instructor, 

2.  Pearson  pr^ytiKit  sesrut  coefficients  of  correlation  were 
computed  t>*tvw«v?  the  grades  made  on  the  first  and  the 
second  flights  selected  in  (1),  above. 

5.  Of  the  646  flights  recorded  in  the  experimental  group, 

46  pairs  of  consecutive  flights  were  found  to  have  been 

given  the  ease  student  by  the  aa»e  Instructor. 

4.  Pearson  product  moment  coefficients  of  correlation  vare 
r-omnuted  between  the  grades  made  on  the  first  and  the 
second  flights  selected  in  (3),  above. 

3.  Pairs  of  consecutive  flights  were  then  selected  at  ran- 
dom in  both  groups  from  among  the  remaining  pairs  of 
consecutive  flights  given  by  different  instructors. 

a.  This  random  selection  w^s  stratified  to 
maintain  the  some  proportion  of  syllabus 
nuikberedl  flighls  as  was  found  in  (i)  uud 
(3)  above. 

b.  This  selection  wua  also  stratifi***  vith 
respect  to  instructor  sc  that  one  of  the 
instructors  of  each  pair  corresponded  vith 
that  selected  In  (1)  and  (3),  above. 

6.  Pearson  product  moment  coefficients  of  correlation 
were  computed  between  the  first  and  the  second 
flights  of  the  pairs  selected  in  (5),  above. 


The  resultant  coefficients  of  correlation  are  presented  in  Table  DC. 
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A a examination  of  these  relationships  reveals  a distinct  contrast  in  ooth 
•By  control  groio  end  th®  eqicriaiatjS  group  between  the  relationships 
of  consecutive  flights  graded  by  the  sane  instructor  and  consecutive 
fli&Lts  graded  by  different  instructors  on  ATJ  grades.  !Dse  total  scare 
relationship  Is  .38  in  the  control  group  and  .42  in  the  experimental 


CORRELATIONS  BETWEEN  PAIRS  OF  FLIGHTS  GR&DH)  BY  THE 
SAME  BBTHDCTOR  AMD  £7  DIFFERENT  INSTRUCTORS 


CONTROL  QROnP  EU’ERIMfliTAL  GROUP 


ATJ  GRADES  ATJ  GRADES  EXPERIMENTAL  GRADES 


SB 

Sans 

Different 

Sent" 

Different 

Ssm 

Different 

FLIGHT  .36 

.07  * 

.37 

.11  * 

.45 

.36 

ATTRIBUTE  .48 

.05  * 

.41 

.04  * 

TOTAL  .?8 

.01  - 

i-/* 

.10  * 

.*5 

«32 

* 

(Difference  significant  at  .01  level) 


group  between  pairs  of  flights  graded  by  ths  same  izustruetar.  Similarly, 

a relationship  of  .4-5  existed  between  experimental  grades. 

The  resultant  correlation  between  pairs  of  consecutive  flights  given  by 
different  instructors  shows  a startling  contrast  *Len  graded  by  the  ATJ 
method  in  both  the  control  and  experimental  groups.  The  total  score  cor- 
relation were  S01  and  .10.  Each  of  these  differs  significantly  from  the 
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respective  correlations  cbtalred  under  seraa-iEatruetor  conditions  3 The 
significance*  of  these  differences  is  at  the  .01  level.  Hovaver,  whan  the 
objective  grades  made  on  the  same  flights  were  correlated  for  the  palm 
given  hy  different  instructors  a relationship  of  .3 6 was  found,  the  dif- 
ference between  ,3 6 and  .45  for  this  size  sample  is  not  a significant  one. 
While  there  appears  to  be  ease  effect  of  the  same  instructor  In  the  grad- 
ing of  the  experimental  forms  it  appears  to  be  considerably  less  than  the 
significant  effect  «?t*d  cxu  the  ATJ  grades. 


Analyst*  of  Instrustor  ftgljaio 


The  questionnaires  described  in  Chapter  111,  above,  were  analyzed  in  sev- 
eral ways  and  revealed  opinions  of  the  flight  Instructor's  participating 
in  the  study.  Regarding  the  hazards  Involved  la  the  use  of  the  experimen- 
tal in  flight  grading  methods,  15  out  of  the  28  Instructors  felt  that 
these  grading  forms  were  unsafe  for  use  in  the  Instructor  Basic  Training 
Unit,  While  1}  leii  i»H^  irelw  ouief  vOuueruxug  uicir  possible  use  at 
Whiting  Field  for  grading  Koval  cadets  in  the  Primary  stage,  26  out  of  28 
felt  they  were  unsafe. 


On  the  item  referring  to  the  possible  superiority  of  the  experiments!  grad- 
ing forms  to  the  ATJ  forms  for  specific  purposes,  out  of  28  instructors, 
the  following  opinions  were  found: 

a.  21  instructors  felt  that  the  experimental  grading 
forme  were  superior  to  the  ATJ  grading  forms  for  de- 
briefing the  student  immediately  following  the  flight. 

b.  22  instructors  felt  that  the  experimental  grading 
for!5£  were  superior  for  board  reviews  of  student  per- 
f^rmnce.  for  determining  whether  or  not  a student 
should  be  allowed  to  continue-  in  the  program. 
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o.  IT  instructors  felt  that  the  esperlnentaX  forsas  were 
superior  for  permanent  proficiency  records. 

Numerous  ccaanents  were  also  noted  by  the  authors  of  the  usefulness  of  these 

forme  in  diagnostic  reviews  of  student  deficiencies. 

When  asked  if  the  e^ariaentftl  grading  for**  wtr-  soe*  valuable  for  daily 
instructional  flights,  for  cheok  flights,  or  for  both,  the  following 
break-down  of  responses  was  obtained: 


Daily  ixwtructionsl  flights  - --  --  --  --  - — 1 
Check  Flights  - - - --  -.----.-------18 

Both - - ~ - - 7 

Neither  - --  --  --  --  --  --  --  --  --  --  - 2 

Total  Responses  ..  - --  --  --  --  --  --  28 


There  appeared  to  be  a definite  feeling  that  these  forms  were  most  valuable 
for  check  flights.  One  reason  for  this  in  that,  on  a check  flight  no  in- 
struction takes  place.  Ine  student  is  merely  obuerved  and  rated  on  his 
ability  to  perform  the  required  maneuvers.  In  contrast  to  this,  ins  true- 

actual  instruction  of  the  student.  Consaanta  were  noted  by  the  authors  to 
the  effect  that  filling  out  the  grading  fora  interferred  with  such  instruc- 
tion. 

On  the  question  of  whether  or  not  the  erperiaeniai  grading  forms  could  be 
shortened  and  still  give  an  accurate  account  of  what  the  student  did,  the 
group  poll  was  divided  fifty-fifty  on  the  "yes"  end  "no"  responses. 

A hypothesis  was  considered  that  instructor  feeling  toward,  and  opinions 
regarding,  these  grading  forms  sight  be  effected  by  the  amount  of  experience 
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end  length  of  tins  vita  which  th«y  used  the  Tjrvta,  In  ardor  to  evaluate 
tin  possible  relationship  between  responses  to  tbs  questionnaire  iters?  and 
experience  ia  tsce  of  the  foxrai,  toe  group  of  instructors  was  diohotoelssd, 
both  ia  team  of  safe*?  of  form  filled  oat,  tad  ia  terms  of  length  of  tins 
served  ia  the  experimental  study.  Instructors  ranged  frea  six  to  forty- 
me  with  respect  to  auxfcer  of  esperlnsntal  gracing  fora*  filled  cat  in  this 
study,  while  e range  of  two  weeks  to  twelve  weeks  wsub  found  in  isms  of 
participation  in  the  study. 


The  resultant  dichotomies  were  evaluated  according  to  ncthods  set  forth  by 
Kendall  (6:55,44).  These  relationships  are  stmaarlsed  in  Tables  X and  XI 
and  indicate  'jartain  significant  trends. 


TABLE  X 

KELATIOJBHirS  BETWEEN  INSTRUCTOR  OPOJIOH 
AND  HUMBER  OF  FORMS  GRADED 


SKLATI0K1HUA  TESTED 


Rawer  of  flight*  graded  vs.  safety  opinion 
Hnaber  of  ftiefista  arreded  vs.  Biroeriority  over  ATJ 
Hasher  of  flights  graded  vs.  value  for  cheek  flights 
Noahs?  of  flight?!  graded  vs.  shortening  of  foxas 


w«  S/vaz^** 

.20  .66 

>2  2,21  (oO?) 

.5fc  1.9B  (.05) 

.62  2.22  (.05) 


Estimate  of  Pearson  product  scssst  coefficient  of  correlation  frost 
tan  value. 

**  Positive  products  sinus  negative  products  of  a two-fold  table  divided 
by  the  respective  variance  (6t4V*, 


Cz,  the  question  of  safely  of  la-flight  grading,  no  aignif leant  relation- 
ships ware  noted,  nor  was  u significant  relationship  noted  between  opinions 
regarding  shortening  of  the  forms  and  length  of  time  exposed  to  ■Urfa  method 
of  grading.  On  each  of  the  other  questions,  however,  relationships  signi- 
ficant at  the  .0?  level  of  confidence  were  found,  indicating  that  opinions 

TABLE  XI 

lUi^iuwSmrS  SZTwKSt  INSTRUCTOR  OPINION  AND  LENGTH  0? 

TIKE  EXPOSED  TO  EXPERIMENTAL  GRADING 


RELATIONSHIPS  TESTED 


S/varS** 


! 

! 

j 

Length  of  time  vs.  safety  opinion 

.5* 

) 

1.14 

Length  of  time  vs . *upwt  ovar  >TJ 

.66 

2.3?  (.05) 

Length  of  tiis?  vs*  value  for  ©heels  flights 

.5b 

2.00  (.05) 

i 

l 

j 

i 

i 

Length  of  time  vs.  shortening  of  fort® 

.^3 

X.4B 

1 

* M W ut  jroatWM  juvwuv  w 

tan  value. 


ffi-Iest  of  correlation  from 


*»  Positive  products  minus)  negative  orodoota  of  a two-fold  table  divided 

by  ths  re^peettrs  usrisaee  {t-ikk) . 


regarding  m^periority  and  value  of  the  experimental  grading  ferae,  and 
regarding  the  possibility  of  shortening  these  forms,  is  positively  related 
to  the  sunber  of  flights  graded.  Similar  positive  relationships  are  also 
found  between  length  of  tine  as  an  experimental  Instructor  end  opt  alone 
th&t  th)  forms  are  superior  for  specific  purposes  and  that  they  are  of  value. 


Instructors  were  given  an  opportunity  to  sake  unstructured  coanraats  about 
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the  grading  forms  on  these  questionnaires.  These  eoEs==Bts  hare  been  ss^ 
onrined  in  Figure  1 and  are  of  interest  at  this  point.  The  nuabere  in 

5 

parentheses  in  Figure  1 indicate  the  nuaber  of  occurrences  of  such  a stats- 

4 

stent. 
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i 

t 

ihe  critical  comments  were  divided  generally  into  two  categories;  the  first, 
of  these  represents  the  opinion  that  In-flight  grading  requires  too  such 
attention,  and  the  cecord  refers  to  suggested  revisions  in  the  content  of 
the  form.  It  is  noted  in  Figure  1 that  the  idea  of  in-flight  grading  re- 
quiring ^ead-in-cockpit*  time  was  expressed  for  two  reasons  differing 
considerably  in  nature.  One  c-f  those  considerations  «a*  for  safety  in 
flight  while  the  other  referred  to  detraction  from  instruction  time.  The 
flow  lines  in  Figure  X illustrate  these,  and  other  opinions,  expressed  by 
flight  instructors.  It  must  be  pointed  out  to  tha  reader  of  Figure  1 that 
the  number  of  occurrences  do  not  total  within  classifications,  sines  more 
than  one  comment  may  have  been  made  by  the  same  instructor. 
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CHAPTER  VI 

DISCUSSION  AND  CONCLUSIONS 


< 


Any  conclusions  mde  oca  the  basis  of  this  study  most  be  viewed  la  light 
of  the  limitations  existent  in  the  experimental  design*  Krperienced  Navel 
Aviators  were  used  as  subjects,  sad  were  graded  by  a aeleot  grovp  of  ins- 
tructors, under  experimental  ccodltitsas*  Whether,  or  not,  similar  results 
would  be  obtained  in  a training  unit,  eospoaed  of  cadets  and  less  exper- 
ienced instructors,  can  only  be  suggested. 


It  appears  from  the  data  of  this  study,  however,  that  flight  grading  in 
the  Naval  Air  Basio  Training  Command  could  tee  improved  through  a basic  re- 
vision in  principle.  The  general  plan  of  instructor  evaluation  cf  a stivlent 
in  terms  of  quality  judgments  with  respect  to  other  students  should  be  re- 
vised in  favor  of  recordings  of  performance  with  respect  to  specific  pre- 
determined standards. 


It  is  important  to  note  that  the  frame  of  reference  used  in  the  Navy  ATJ 
grading  form  is  that  of  the  performance  cf  the  51  average'’  student.  This 
consideration  is  probably  the  greatest  shortcoming  of  the  currently  used 
method.  A new  instructor  actually  has  no  way  of  knowing  the  performance 
of  an  "average”  student.  In  order  to  gain  clear  concept  of  this  hypothetical 
average  against  which  he  is  basing  his  judgments,  it  is  necessary  for  him 
to  observe  a large  number  of  randomly  selected  performances  of  each  maneuver 
at  different  stages  of  training.  Ira  til  he  has  observed  ouch  a range  of 
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pertormnce,  hia  concept  of  the  "average”  student  is  necessarily  based  on 
the  United  sample  to  vjhich  he  has  been  exposed*  In  many  cases,  during 
the  first  few  months,  an  instructor  is,  therefore,  grading  a student  against 
the  performance  of  only  the  fev  students  he  has  seen. 

There  is  continuing  evidence  to  support  the  hypothesis  that  performance 
of  flight  skills  varies  considerably  from  flight  to  flight  in  such  a 
aamser  that  the  usual  methods  of  determining  test  reliability  are  not 
applicable.  At  the  outset  of  this  study.  It  was  felt  that  the  reliability 
of  flight  grading  could  be  improved  by  averaging  out  these  day-to-day 
variations  of  student  performance  in  a cocposite  record  of  several  such 
performances, 

Wilccaou  &o«  Johnson  (12)  found  a ride-ride  reliability  of  a«  objective 
grading  form  used  cm  the  A19  check  flight  in  the  Primary  syllabus  of 
this  training  command  in  the  order  of  .51.  While  the  split-half  relia- 
bility of  .71  obtained  in  this  study  is  considerably  higher,  it  still 
leaves  much  to  be  desired  in  the  way  of  consistency  with  respect  to  the 
usual  test  standards*  Also,  this  higher  reliability  can  probably  be  at- 
tributed in  some  measure  to  the  fact  that  experienced  Naval  aviators  were 
used  in  this  study  as  contrasted  with  Naval  air  cadets  irsasureti  by  Wilccxon 
aid  Johnson*  flow  much  of  the  reliability  increase  is  due  to  consistency 
of  day-to-day  performance  end  how  much  is  due  to  the  fact  that  several 
performances  have  been  combined  Is  not  known*  However,  an  indication 
of  ride-ride  reliability  Is  found  i?i  the  halo  analysis  where  correlation 
coefficients  betw^n  grades  made  on  two  consecutive  flight*  appeared  to 


;■  Wte*  a********* 


be  in  the  neighborhood  of  from  .55  to  >5  for  the  group  under  observation. 
From  this  it  does  not  appear  that  Instructors  Under  Training  in  the  Instruc- 
tor Basie  Training  Unit  (Slight)  are  particularly  more  stable  in  perfonp- 
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anee  from  day  to  day  than  are  Naval  air  cadets. 

Gcqparlsona  of  rel  iabilities  between  the  esparimsctal  and  the  ATJ  grading 
forms  revealed  that  the  uxperiaental  grades  were  only  slightly  more  reliable 
than  were  ATJ  grades.  Oils  difference  was  not  significant,  but  the  split- 
half  reliability  of  .71  for  a stage  of  training  probably  represents  as 

high  a reliability  as  is  possible  in  a learning  situation  where  day-to- 
day  fluctuations  o f performance  are  known  to  exist. 

Although  the  grading  of  attributes  appeared  to  be  slightly  less  reliable 
than  the  grading  of  flight  proficiency  on  the  ATJ  fosflas.  thin  factor  pro- 
vided a worthwhile  addition  to  the  flight  scores  obtained  on  the  “experi- 
mental grading  forms*  the  reliability  of  experimental  grades  was  equally 
high  with  the  attribute  boots  added,  end  was  consistently  higher  In  terms 
of  prediction  of  cheek  flights  from  dally  grades.  In  view  of  this,  and 
from  instructor  opinions,  it  Is  felt  that  the  attributes  of  flight  should 
continue  to  be  Judged. 


While  the  ATJ  grades  were  found  to  be  more  reliable  when  used  m the  ex- 
perimental group  than  they  were  in  the  control  group,  this  is  not  the 
case  with  prediction  of  check  flights  from  daily  flights.  X 
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of  validity,  it  appears  ■feat  the  ATJ  grades  ere  slightly  superior  in  the 
experixtental  group  than  they  were  in  the  control  group.  This  may  be  ex- 


plained  by  the  fact  that  the  instructors  is  general  became  sore  aware  of 
the  critical  aspects  of  flight  performance  as  a result  of  the  tryout  of 
the  new  grading  system  and  were  therefore  grading  on  slightly  different 
criteria  than  before. 

Considerations  of  safety,  especially  in  an  area  of  air  saturation  as  is 
found  is  Pensacola,  is  of  utmost  lxqportance  in  the  developmsnt  of  flight 
grading  techniques.  While  57  per  cent  of  the  instructors  felt  that  tfce&o 
grading  forms  ’*sre  a detriment  to  safety,  it  was  felt  by  the  in  vestige  bore 
that  the  actual  safety  h&sard  could  be  considerably  reduced  through  famil- 
iarity with  the  grading  forms  through  continual  use  for  a longer  period  of 
time.  Reference  is  ncd@  at  this  point  to  the  findings  of  Wilooxon  and 
Johnson  (12)  on  this  question  of  safety.  They  found  that  65  per  cent  of 
the  instructors  felt  that  the  objective  cheek  flight  grading  form  used  at 
Whiting  Field  was  unsafe.  The  large  majority  of  those  inn  true  tore,  how- 
ever. felt  that  the  forms  would  not  be  a detriment  to  safety  in  t>*~  air  if 
they  were  shortened.  Considering  this  point,  it  is  interesting  to  note 
that  apnwrrisataly  tha  same  percentage  of  instructors  in  this  study  reported 
herein  felt  that  the  eaq^erimental  grading  forms  wre  unsafe,  although  thee<; 
forms  war©  only  approximately  one-fourth  as  long  the  fossa  used  by 
tfllooxon  and  Johnson. 

Evidence  was  found  to  euppert  the  hypothesis  that  a more  favorable  attitude 
toward  grading  fonc3  of  thic  type  are  found  among  instructors  who  have  used 
the  forms  for  a longer  period  of  time.  It  is.  therefore,  important  that  a 
thorough  period  of  indoctrination  be  giver,  instructors  in  the  use  of  such 
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ferns  before  basing  decisions  tq>on  Instructor  reactions,  la  the  implemen- 
tation of  any  new  method  of  grading,  especially  one  which  requires  sore 
work  on  the  part  of  the  instructor  and  one  which  say  introduce  a need  for 
greater  attention  to  safety  considerations.  It  is  reasonable  to  «sp«et  that 
attitudes  would  be  somewhat  unfavorable  until  such  grading  became  entirely 
familiar. 

The  £2 jar  ~ ancles lun  resulting  from  this  study  centers  around  the  finding 
that  the  experimental  grading  forms  were  influenced  to  a distinctly  lesser 
degree  by  knowledge  of  past  performance.  In  the  halo  analysis  described 
in  Chapter  V above,  it  was  shown  that  when  two  consecutive  flights  were 
graded  by  the  &a ass  instructor,  the  relationships  between  these  two  consec- 
utive flights  was  significantly  higher  than  when  graded  by  two  different 
instructors,  on  the  Navy  AXJ  grading  forma . In  contrast  to  this,  the 
grades  made  on  two  consecutive  flight  uit/wed  little  difference  attribu- 
table to  the  assignment  of  instructors  when  graded  by  the  experimental 
forms.  It  is  felt  that  this  difference  is  attributable  to  the  fact  that 
the  experimental  grading  was  baaed  on  recordings  of  what  the  student 
actually  did  on  the  flight. 

Such  recordings  need  not  be  in  the  form  of  striotly  objective  recordings 
of  instrument  and  dial  readings,  or  of  specific  recordings  of  aircraft 
attitudes,  etc.  Mary  of  the  aspects  of  a student*  c performance  can  be  sea&~ 

objectively  reported  in  the  fora  of  noting  whether  or  Dot  the  student  per- 
form properly  or  improperly  with,  revbpect  to  specific  standards.  As  noted 


* 


in  the  contents  of  the  grilling  forms  developed  in  this  study,  there  are 
many  aspects  of  student  flight  performance  vh4»r«  the  student  is  required 
to  do  a specific  sub-task.  Grading  in  such  cases  can  be  accomplished  by 
merely  recording  'whether  or  not  the  task  was  performed,  not  hew  well  it 
was  performed. 

It  is  theoretically  impossible  for  grades  based  on  uastandardised  "averages'* 
of  unknown  groups  of  students  to  actually  reveal  the  relative  quality  of 
the  student  involved.  It  is,  therefore,  felt  that  In  the  interest  of 
meaningful  evaluation  of  flight  ability,  grading  procedures  be  developed 
on  a basis  of  recordings  cf  exact  performance,  rather  than  cn  subjective 
judgments.  Records  based  on  grades  of  this  type  will  be  more  meaningful 
and  will  better  reflect  student  quality  than  those  in  current  use  in  the 
Haval  Air  Basic  Training  Gosasand. 


CHAPTER  VII 


RECOMMENDATIONS  FOR  IMPLEMENTATION  OF  IMPROVED 
GRADING  TECHNIQUES 

n»  two  major  recoamsndations  which  ere  wade  oca  the  baa  is  of  this  research 
axe: 

1.  That  flight  grading  In  thu  Natal  Air  Basie  Training 
Coosand  be  revised  so  that  It  is  based  upon  recordings 
of  actual  student  performance  rather  than  judgments  of 
quality  based  on  a hypo  the  t leal  "averege" . 

2.  Thai  instructor  judgments  of  attributes  such  os  "mental 
attitude",  "heed work",  "reaction  toward  flight* , and 
"air  discipline”  be  continued  as  part  of  any  future 
grading  system  developed. 

In  order  to  carry  out  a program  of  revision  in  grading  procedures,  several 
basic  steps  must  be  followed.  These  steps  involve  the  development  of  in- 
flight grading  forms  which  differ  in  content  for  jiu\h  flight  of  each  stage 
within  a unit.  Such  forms,  however,  would  oosmcoly  be  based  on  ibe  prin- 
ciple of  a detailed  report  c t performance  with  respect  to  predetermined 
standards*  In  this  «ay;  a sev  insts’ister  would  ba  able  to  accurately  re- 
port the  performance  of  his  student  with  out  having  to  rely  on  experience 
for  E9dci£g  judgments. 

In  soma  cases,  it  seems  feasible  that  certain  portions  of  a flight  grading 
form  sight  be  filled  out  os  the  pfousd,  following  the  flight.  Care  must 
be  taken  in  the  administration  of  such  a program  to  see  thet  such  report- 
ings are  made  Immediately.  One  fault  of  the  current  method  of  grading  is 
that  several  hours,  and  in  gome  eases  several  days,  elapse  before  the  form 
Is  filled  out. 
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Detailed  a ccouhts  of  exactly  vhat  the  student  did  will  find  their  greatest 
use  as  diagnostic  instruments.  The  vmjc  points  of  a student  are  spotlighted, 
and,  in  many  oases,  careful  scrutiny  of  a flight  will  enable  an  instructor 
to  discover  the  underlying  causes  of  a student* s weakness. 


It  is  felt  that  if  a program  of  in-flight  grading  Is  established  along 
these  lines,  following  the  steps  indicated  below,  a sounder  basis  nay  be 
reached  for  effective  screening  and  adequate  evaluation  of  training  methods. 

1.  Individual  grading  forres  should  be  developed  to  meet 
the  specific  needs  of  each  training  syllabus. 

2.  -She  critical  aspects  of  each  maneuver  to  be  graded 
srast  be  determined  by  experienced  instructors. 

3.  Standards  of  performance  should  be  established  *- 
gainst  which  ratings  are  to  be  made* 

4.  These  standards  must  be  clearly  defined  and  thor- 
oughly understood  by  all  instructors  through  a 
ccatinuiag  program  of  iz^cctriaatioa  and  stsa- 

dardlsatioa. 
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Only  maneuvers  which  here  been  introduced  prior  tc  or  on  this  flight  in  accordance 
with  the  syllabus  shad!  be  graded.  Attributes  will  be  graded  on  every  flight.  Marks 
shall  be  awarded  comparatively  on  the  basis  of  the  expected  progress  toward  the 
established  standard. 
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TOUCH-AND-GO  LANDINGS 


J (Grad®  only  the  first  two  approaches  • 
j of  type  checked  below)  j 

I , ! 

£1/2  Flap  Full  Flap  Nc  Flap  | 


INDICATE  THE 

IstT 

6th 

APPROACHES 

2ndT 

7th 

GRADED  ON 

3rdT 

8th 

THIS  PAGE: 

LthP 

9th 

5thC 

10th 

Interval: 

Proper  [TJ  [2]  long  00  short  h 0 


Voice*  Reports ; 

Wheels  Down 
Brakes  Pumped 
Downwind  a*k: 

Airspeed  .. 


res  No 
0 0 
a 0 


Ye*  No 

0 0 
0 0 

.Altitude 


(Indicate  first  and  second  landings  by  a "l"  and  a "£n.) 
Approach: 

Airspeed  Ct  the  QCt°  rv*r.±+.±r>n  • & > * j 

1 " 1 mr  -J.  A rt.  A J \ 


Alignment 

Correct 

Left 

Right 

X-Wind  Procedure 
(grade  only  if  these 
are  X-wind  landings) 
Proper 
lapreper 


Distance 

Proper 

Short 

Long 

Transition  Altitude 
Proper 

U! 

**-*-C>*J 


-1  2. 

H S3 
1 |2 


~W~1 5 80  85  90 

Touchdown: 

Contact 
Straight 
Left  Skid 
Right  Skid 

landing 
3 Point 
High  St*n 

Wheels 

Point  on  Runway 
Within  Area 
Outside  Area 

Stick  on  Rollout 
Full  Back 
Other 

Takeoff  Nose  Attitude: 

Proper 

Low 

High 

PeychCorp~SAM  12- 
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GSMEKAL  ASSESSMENT  OF  ALL  TCUCH-AND  GO  LANDINGS 

To  be  graded  on  ground 
immediately  after  flight 

j i. 

- Smooth  ' ; 

S ONC 

t 

« Omitted  a Necessary  ! 
Correction  j 

MANNER  OF  MAKING  CCPSEC7E0NS: 

S SB  ONC 

U/C  Track  in  Downwind  Lag 

i 

□ □a 

y/C  Altitude  aai  A/S  - Downline!  Leg 

□ □□ 

M/C  Track  in  Approach 

□ □□ 

U/C  Altitude  and  A/S  - Approach 

□ □□ 

lt/C  Altitude  and  A/S  - Straightaway 

□ □□ 

ii/G  Direction  during  Rollout 

□ □□ 

ly  C Direction  tfcxing  Takeoff 

□ □□ 

U/C  Altitude  and  A/S  during 
Takeoff  and  Climbout 

□ □□ 

a 

Proper 

Slightly 

Improper 

Use  of  Trim  Throughout  Hop 

□ 

□ 

Use  of  Flap  Throughout  Hop 

□ 

A 

n 

No 

One  or 
More 

Use  of  Prop  Pitch 

n 

i__i 

□ 

i 

i 
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STANDARD  FIELD  ENTRY 

ENTRY  INTO  TRAFFIC  CIRCLE: 

LANDING  XO  JJST  VOICE  REPORT: 

rx'Op6r  1 

Improper  LJ 

Proper  1 

Early  or  Late 
Quite  Gna  Item  L_ 

1 

ALTITUDE  IN  TRAFFIC  CIRCiifi: 

AIRSPEED  IN  IETD0WN: 

L l * 

. 

800  9C0  1000  1100  1200 

85  90  95  100 

105 

AIRSPEED  IN  TRAFFIC  CIRCLE: 

IETDGM  TRACK: 

Proper  Distance  ! | 
Improper  Distance  1 1 

110  115  120  125  130 

500'  TRANSITION: 

SELECTS  BEST  TAJIK: 

Yes  □ 

No  D 

Smooth 

Slightly  Rough  j 

TRANSITION  ALTITUDE: 

* t i i 

POV/ER  RETARD,  WHEELS  DOM 
AND  POV/ER  ADDITIONS 

400  450  500  550 

Too~ 

Proper 

Improper 

TRANSITION  AXES  FEED: 

1 

altitude  until  reaching  95  kts-. 

80  85  90  95 

100 

8oo  900  iooo  noo  1200 

OVERALL  RATING  OF  ENTRY: 

LOWERS  1/2  FLAP: 

Props r [' 

Sli^tly  High  Cl 

Slightly  Low  j 

Below  500' 

Excellent  | 
Good  t 
Fair 

Poor  1 

FsychCorp-SAM  3-2(Rev  2) 
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STREP 

TURKS 

LEFT  TURN 

RIGHT  TURN 

ENTRY  PROCEDURES 
**  1 ' 

Proper  [~~j 

Proper 

□ 

Improper  Q 

Improper 

□ 

ANGLE  OF  BANK 

(Check  both  Minimum  and  Maximum  Angle  Observed) 

30  35  40  45  50  55  60 


30  35  40  45  50  55 


ALTITUDE  CONTROL 

(Check  Maximum  Deviation  from  Base  Altitude) 


-200  -100  BA  *100  *200 


-200  -100  BA  +100  *200 


Proper 

Improper 


Proper  □ 

Improper  □ 


ROLLOUT 

(Check  Deviation  from  Baee  Heading) 


10  -5  BH  *5  +16 


-10  -5  KI  *5  +10 


USE  OF  RUDDERS  DURING  TURNS 


Excellent 

Good 

Fair 

Poor 


Excellent 

Good 

Fair 

Poor 
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STALLS 


(For  each  type,  grade  only  the  first  stall  after  demonstration) 


PROGRESSIVE  STALL!  STEEP  TURN  STALL  (LEFtF]  ! STEEP  TURN  STALL  (RIGHT) 


MADE  CLKAJtilfiO  TUttN: 


ENTRY  AIRSPEED:  (Indicate  Maxi  mum  deviation  from  proper*) 


-10  -5  0 +5  *0  0 


-10  -5  0 *5  +1< 


NOSE  ATTITUDE  AT  TIME  OF  STALL: 


Proper 

Slightly  High 
Slightly  Low 


Proper 

Slightly  High 
Sli^itly  low 


WHIG  POSITION  AT  TIKE  OF  STALL: 


Correct 
Sli^vtly  Off 
Considerably 
Off 


Correct 
Sli^itly  Off 
Considerably 
Off 


*5  +l 


I i s 


Proper 

Slightly  High 
S!igjhtly  Low 


Correct 
Slightly  Off 
Considerably 
Off 


7 Off  ~ 
L'ably 


POKER  SETTING: 


Proper 

Slightly 

Improper 


Proper 

Slightly 

Improper 


Propex 

Slightly 

Improper 


RECOVERY: 

Excellent 

Good 

Fair 

Poor 


Excellent 

Good 

Fair 

Poor 


Excellent 

Good 

Fair 

Poor 
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STALLS 


(For  each  type,  grade  only  the  first  stall  dcwCiis  trat  ion  ) 

j APPROACH  TURN  STAlI] 


MADE  CLEARING  TURN: 


Tes 

No 


R 


, TRIM  TAB  STALL 

| SKIDDED  TURN  STALL  | 

! r B 

EZ 

No  £ 

ENTRY  AIRSPEED:  (Indicate  Maximum  deviation  from  proper*) 


— i 1 1 j 

-10  -501.5 

*10 

— i 1 1 i i 

-10  -5  0 *5  *10 

— 1 1 1 l__ 

-10  -5  0 *5  *10 

NOSE  ATTITUDE  AT  THE 

OF  STALL: 

i 

Proper 

— 1 

j 

Prone r j 

f 

1 j 

1 

Proper 

n 

Slightly  High 

□ 

Slightly  High 

H 

Sli^itly  High 

— 

Slightly  Low 

□ 

j 

Sii^itly  Low  j 

td 

Sli^itly  low 

— 

WING  POSITION  AT  TIME 

OF 

STALL: 

i 

Correct 

i — 1 

Correct 

— 

1 

Correct 

— 

Slightly  Off 

H 

Slightly  Off 

Slightly  Off 

Coos iderafclr  ! 

l i 

■ i 

n — ^ a a ~ — 

vw*jw  J.UUA  auojf 

Considerably 

Off  ! 

L 1 

Off 

tK^mm 

Off 

— 

POWER  SETTING: 

Proper 

Slightly 

Improper 


RECOVERY: 

Excellent 

Good 

Fair 

n. 

rvvr 


d 3 


Proper 

Slightly 

Improper- 


Excellent 

Good 

Pair 

Poor 


B 


a a a 


tf 


Proper 

SU^tly 

Improper 


CiA-ceJ  isnr. 

Good 

Fair 

Poor 


H 
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NEAR  STALL 


I CLIMBING  TURN  STAI 


POWER-OFF  STALL 


MADE  CLEARING  TURN: 


-10  -5  0 *5  +10 


-10  -5  0 *5  *10 


-10  -5  0 +5  +10 


NOSE  ATTITUDE  AT  THE  OF  STALL: 


Proper 

Slightly  High 
Slightly  Low 


Proper 

Slightly  High 
Slightly  Low 


Proper 

Slightly  High 
Slightly  Low 


Proper 

Slightly 

Improper 


Proper 

Slightly 

Improper 


Proper 

Slightly 

Improper 


RECOVERY: 

Excellent 
Good 
i F?.ir 

! Poor 


j j i 

r i 
a i 


1 A »4 
ioAV  Ox.kwuv 


Excellent 

Good 

Fair 

Poor 

T\; ^ n *U  f 

X p~\J  fJH  tf — «wyn,v 


STALLS 


(For  each  type,  grade  only  the  first  stall  after  demonstration) 


ENTRY  A IRS  FEED:  (Indicate  Maximum  deviation  from  proper.) 


WING  POSITION  AT  TIME  OF  STALL: 


Correct 
Slightly  Off 
Considerably 
Off 


POWER  SETTING: 


Correct 
Slightly  Off 
Considerably 
off 


UoiTecx. 
Slightly  Off 
Considerably 
Off 


PRECISION  SPINS 


IS  FT  SPIN  RIGHT  SPIN 


ENTRY  PROCEDURES 


Correct 

□ 

□ 

Incorrect 

□ 

□ 

PROPER  USE  OF 
CONTROLS  CORING  ROTATION: 

Yes 

□ 

□ 

No 

□ 

□ 

PROPER  USE  OF 
CONTROLS  FOP,  RECOVERY; 

lea 

1 — i 

u 

□ 

No 

□ 

□ 

STARTS  RECOVERY: 

At  1.-1/ 2 turns 

□ 

□ 

Slightly  Early 

□ 

□ 

Slightly  Late 

n 

: ! 

r~i 

I i 

AIRSPEED  ON  RECOVERY: 

(Indicate  left  spin  by  e.  and  right  spin  by  a "2".) 


I * S. I ■ A 

120  130  I4O  150  160 


PsychCorp-SAM  4-3 (Rev  2) 


SPIRALS 


POSER-OFF 


ANGIE  OF  BANK 

[Indicate  maximum  deviation  throughout] 


AIRSPEED 

(Indicate  maximum  deviation  throughout) 


110  115  120  125  130 


*5  90  95  10 0 3,05 


Correct 

Incorrect 


RECOVER!  FRtJCSDUEBS 

j Correct 

1 Incorrect 


Correct 

□ 

Correct 

U 

stall-  t0  Establish 

□ 

Falla  to  Establish 

□ 

Normal  Cruise 

Normal  Cruise 

Fails  to  Establish 

□ 

Fails  to  Establish 

□ 

Proper  Glide 

Proper  Glide 

j 

* i 


\ i 


ENTRY: 

THROTTLE: 

NOSE  ATTITUDE: 


mssLUA m 

Proper  Q One  or  More  Errors  [~] 

Sxc  silent ! j Good  { | Fail  | } Foot  j J 

Excellent [31  Good  [[Jl  irQPoor  j \ 
Proper  Q One  or  More  Errors  j 


MAXIMUM  HEADING  DEVIATION: 


MAXIMUM  ALTITUDE  DEVIATION : 


-30  -20  -10  BH  *10  *20  4-30 

^150  -100  -50  BA  +50  *100  ♦150 

PsychCarp-SAM  5-2 


I 

i 


HIGH  ALTITUDE  EMERGENCY 

INITIAL  PROCEDURES : Correct 

One  or  Here  Error? 

VOICE  REPORT:  Correct 

One  or  More  Errors 

PATTERN  (to  wave-off  position): 

Excellent!  j Qoodf3  Fkir£_]  Poor 


On  #1  Fositioa 

Slightly  off 
£1  Position 

AT  500'  ALTITOEE 


Voice  Report 

Correct  HLste.ijee 

Yes 

□ 

Would  Overshoot 

No 

! 1 
l 1 

ili/Mtl  f* 

WAVE-OFF  PROCEDURE: 

Correct 
Incorrect 

PsychCorp-SAM  5-4 (Rsv  .3)  | 


□ 

□ 


1500'  ALTITUDE: 

Correct  Distance 

□ 

Slightly  Close 

n 

oxjLgfiux^r  njyX'o 

r~i 
! 1 

□ □□  □□  □ □□  □□ 


POSITION  & DISTANCE  AT  CUT: 


Cwfx-»cily  oa  j ’ 

Ahead  or  Behind  ? 

Close  or  Wide  j I [“1 


900  950  1000 


AIRSPEED  AT  COT 


110  115  120  125 


ALTITUDE  AT  95  KNOTS: 

’900  950  lobo  1050  lisr 


PROP  PITCH 


! GLIDE  PATTERN: 
Excellent 


AIRSPEED  UNTIL  FLAPS  DOWN: 
j ”85  90  95  100  105 


LANCING  TRANSITION: 

Excellent 

□ 
1 j 

Coed 

Pair 

H 

Poor 

td 

POINT  OF  TOUCHDOWN: 

First  1/3 
Beyond 
Wa're-Off: 
(Student  error 


□ □ 

,b  ti 


B B 


CLIMB  OUT  PROCEDURES: 

Correct 
Missed  one  or 
more  items 


CLIMB  OUT  PATTERN: 

Excellent 

Good 

Fair 

Poor 


TRANSITION  TO  NORMAL  CRUISE: 


Proper 

Improper 


□ n 
□1-0-1 


▼ AW  a *r  m th  w »tt>  t»»  n-ni  r d 

XJUU  AJU'  XlUUCi  rjM£«UUi'jFfUX 


GEAR  UP  CHECK  j 

i 

Tea  n Mo  ! ! 

< I I — » 

PROP  PITCH  LOW: 

Iss  1 i No  j j 


SELECTION  OF  LANDING  SITE 

ate  silent  □ Fair 


. Poor 


USE  OF  FLAP 


j j jjilpr.  fpei-  j [ i 


WAVE  OFT  PATTERN 
Excellent ! ! 


Psycknorp-SAM  8-2(R 


Because  of  our  limited  supply,  you  are  requested  to  return  this  copy  WHEN  IT  HAS  SERVED 
YOUR  PURPOSE  so  thst  it  may  be  made  available  to  other  requesters.  Yuiif  cooperation 
Will  be  appreciated. 


NOTICE:  WHEN  GOVERNMENT  OR  OTHER  DRAWINGS,  SPECIFICATIONS  OR  OTHER  DATA 
Uttm ms>  FOR  ANY  PURPOSE  OTHER  Tr AN  IN  CONNECTION  WITH  A DEFINITELY  RELATED 

\\y> rvr« r to r? -.urr? iw»p  rmipp  Tire  ?t  c ■rvwvpMftfflE'V’P  Tns’uwisv 

av  t AJ*  V4.  * A.  *.  *.<«  W-  W a.  A MAW.;  j*.  W’A  » j •«-  »«■>  * • W • S»«»T*  » •»  ■—  ■*»  •*.  4*M  W<ltW 

NO  RESPONSIBILITY.  NOR  ANY  OBLIGATION  WHATSOEVER;  AND  THE  FACT  T±*T  Tfi$4< 
GOVERNMENT  MAY  HAVE  FORMULATED.  FURNISHED.  OR  IN  ANY  WAY  SUPPLIED  THE  * 4 

SAID  DRAWINGS,  SPECIFICATIONS,  OR  OTHER  DATA  IS  NOT  TO  BE  REGARDED  BY 
IMPLICATION  OR  OTHERWISE  AS  IN  ANY  MANNER  LICENSING  THE  HOLDER  OR  ANY  OTHER 
PERSON  OR  CORPORATION,  OR  CONVEYING  ANY  RIGHTS  OR  PERMISSION  TO  MANUFACTURE 
USE  OR  SELL  ALT  PATENTED  INVENTION  THAT  “MAY  IN  ANY  WAY  BE  RELATED  THERETO. 
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